-- Logs begin at Wed 2022-06-01 03:05:40 UTC, end at Wed 2022-06-01 04:53:16 UTC. -- Jun 01 04:18:23.548840 dv-cinder-667108-37-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 01 04:18:23.558093 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 01 04:18:23.560172 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 1 04:18:23 2022] *** Jun 01 04:18:23.560172 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 01 04:18:23.560172 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 01 04:18:23.560172 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: nodename: dv-cinder-667108-37-iscsi Jun 01 04:18:23.560172 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: machine: x86_64 Jun 01 04:18:23.560172 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: clock source: unix Jun 01 04:18:23.560172 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: pcre jit disabled Jun 01 04:18:23.560172 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: detected number of CPU cores: 4 Jun 01 04:18:23.560172 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: current working directory: / Jun 01 04:18:23.560172 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: detected binary path: /usr/bin/uwsgi-core Jun 01 04:18:23.560961 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: your processes number limit is 47680 Jun 01 04:18:23.560961 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: your memory page size is 4096 bytes Jun 01 04:18:23.560961 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: detected max file descriptor number: 2048 Jun 01 04:18:23.560961 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: lock engine: pthread robust mutexes Jun 01 04:18:23.560961 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: thunder lock: enabled Jun 01 04:18:23.560961 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 01 04:18:23.560961 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 01 04:18:23.605340 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: Python main interpreter initialized at 0x5575ce39a9c0 Jun 01 04:18:23.605340 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: python threads support enabled Jun 01 04:18:23.605340 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: your server socket listen backlog is limited to 100 connections Jun 01 04:18:23.605340 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: your mercy for graceful operations on workers is 90 seconds Jun 01 04:18:23.605698 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: mapped 403077 bytes (393 KB) for 2 cores Jun 01 04:18:23.605780 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: *** Operational MODE: preforking *** Jun 01 04:18:23.606007 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: *** uWSGI is running in multiple interpreter mode *** Jun 01 04:18:23.606007 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: spawned uWSGI master process (pid: 103907) Jun 01 04:18:23.606218 dv-cinder-667108-37-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 01 04:18:23.607834 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: spawned uWSGI worker 1 (pid: 103908, cores: 1) Jun 01 04:18:23.607834 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: spawned uWSGI worker 2 (pid: 103909, cores: 1) Jun 01 04:18:23.607834 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 01 04:18:24.847906 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 01 04:18:24.848675 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 01 04:18:25.579381 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 01 04:18:25.579381 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: from cryptography.utils import int_from_bytes Jun 01 04:18:25.579724 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 01 04:18:25.579724 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: from cryptography.utils import int_from_bytes Jun 01 04:18:25.579905 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 01 04:18:25.579905 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: from cryptography.utils import int_from_bytes Jun 01 04:18:25.580098 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 01 04:18:25.580098 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: from cryptography.utils import int_from_bytes Jun 01 04:18:28.212551 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 01 04:18:28.213224 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 01 04:18:28.213376 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 01 04:18:28.213657 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 01 04:18:28.214028 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 01 04:18:28.214116 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 01 04:18:28.214213 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 01 04:18:28.214296 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.214450 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 01 04:18:28.214619 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.214821 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 01 04:18:28.214943 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.215083 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 01 04:18:28.215291 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.215552 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.215638 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.215889 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.216001 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.216215 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.216314 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.216541 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.216635 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.216874 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.216973 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.217134 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.217221 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.217452 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.217540 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.217778 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-667108-37-iscsi {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.217867 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.218101 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.218195 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.218375 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.218470 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.218696 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.218782 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.219015 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.219149 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-667108-37-iscsi {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.219334 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.219440 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.219662 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.219749 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.219967 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.220052 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.220287 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.220466 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.220596 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.220934 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.221202 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.221315 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.221516 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.221739 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.221848 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.222054 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.222158 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.222373 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.222468 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.222682 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.222785 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.223021 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.223119 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.223361 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.223591 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.223737 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.223930 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.224073 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.224207 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.224353 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.224482 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-667108-37-iscsi {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.224622 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.224760 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.224951 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.225124 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.225301 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.225473 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-667108-37-iscsi {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.225618 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.225808 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.225947 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.226123 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.226313 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.226496 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.226697 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.226826 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.226955 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.227097 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.227265 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.227429 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.227623 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.227775 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.227936 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.228076 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.228275 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.228419 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.228576 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.228708 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.228876 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.229018 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.229184 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.229308 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.229493 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.229617 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.229809 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.229944 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.230112 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.230245 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.230417 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.230540 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.230672 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.230859 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.230985 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.231116 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.231267 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.231464 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.231604 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.231732 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.231887 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.232023 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.232147 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.232287 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.232416 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.232550 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.232695 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.232894 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.233020 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.233167 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.233290 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.233421 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.233598 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.233721 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.233902 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.234025 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.234208 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.234340 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.234500 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.234623 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.234806 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.234939 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.235111 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.235235 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.235443 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.235567 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.235762 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.235885 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.236081 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.236205 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.236401 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.236525 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.236713 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.236866 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.237007 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.237134 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.237330 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.237537 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.237659 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.237781 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.237943 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.238074 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.238282 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.238422 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.238578 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.238700 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.238891 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.239014 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.239206 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.239369 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.239550 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.239674 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.239857 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.239989 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.240162 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.240296 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.240467 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.240590 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.240782 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.240904 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.241091 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.241222 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.241385 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.241509 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.241676 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.241798 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.241981 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.242104 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.242288 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.242417 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.242587 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.242709 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.242912 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.243033 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.243187 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.243397 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.243538 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.243667 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.243803 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.243926 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.244099 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.244222 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.244394 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.244530 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.244697 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.244821 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.245002 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.245125 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.245308 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.245446 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.245612 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.245995 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.246186 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.246309 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.246490 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.246631 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.246796 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.246981 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.247111 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.247242 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.247438 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.247582 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.247745 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.247865 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.248039 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.248171 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.248344 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.248485 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.248651 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.248783 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.248960 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.249085 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.249264 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.249396 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.249569 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.249703 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.249942 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.250074 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.250258 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.250396 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.250566 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.250690 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.250886 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.251020 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.251207 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.251365 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.251511 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.251634 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.251828 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.251950 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.252130 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.252266 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.252437 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.252562 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.252754 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.252875 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.253058 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.253181 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.253360 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.253481 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.253663 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.253785 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.253964 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.254097 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.254269 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.254391 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.254571 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.254692 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.254855 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.254989 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.255157 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.255279 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.255474 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.255596 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.255780 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.255911 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.256085 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.256210 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.256386 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.256521 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.256693 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.256815 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.257002 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.257148 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.257847 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.258000 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.258155 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.258278 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.258462 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.258586 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.258783 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:18:28.258924 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.259124 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.259251 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.259486 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.259611 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.259815 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.259972 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.260135 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.260259 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.260447 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.260581 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.260762 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.260886 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.261088 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.261214 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.261402 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.261539 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.261696 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.261820 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.262005 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.262147 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.262325 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.262448 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.262636 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.262757 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.262950 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.263074 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.263264 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.263428 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.263605 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.263750 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.263925 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.264058 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.264234 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.264358 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.264590 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.264788 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.264955 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.265117 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.265282 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.265434 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.265561 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.265686 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.265821 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.265955 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.266076 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.266211 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.266380 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.266505 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.266722 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.266846 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.267063 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.267249 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.267397 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.267585 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.267709 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.267920 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.268099 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.268236 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.268358 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.268547 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.268682 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.268862 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.268998 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.269176 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.269311 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.269500 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.269624 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.269833 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.269968 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.270145 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.270269 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.270455 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.270579 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.270767 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.270910 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.271081 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.271206 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.271426 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.271571 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.271721 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.271858 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.272037 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.272162 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.272354 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.272492 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.272668 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.272804 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.273600 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.273728 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.273920 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.274057 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.274229 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.274363 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.274578 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.274705 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.274883 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.275005 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.275190 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.275336 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.275518 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.275680 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.275836 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.275960 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.276165 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.276300 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.276475 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.276597 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.276783 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.276905 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.277106 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.277228 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.277404 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.277527 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.277715 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.277850 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.278025 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.278252 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.278384 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.278509 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.278636 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.278772 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.278927 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.279091 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.279236 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.279386 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.279574 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.279713 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.279885 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.280009 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.280193 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.280335 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.280500 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.280639 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.280810 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.280942 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.281117 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.281239 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.281426 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.281561 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.281756 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.281884 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.282066 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.282192 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.282382 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.282506 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.282701 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.282836 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.283014 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.283149 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.283348 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.283481 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.283668 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.283793 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.283983 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.284125 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.284311 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.284448 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.284616 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.284738 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.284937 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.285087 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.285257 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.285381 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.285575 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.285711 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.285881 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.286019 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.286192 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.286315 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.286504 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.286627 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.286811 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.286946 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.287115 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.287239 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.287452 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.287595 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.287755 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.287902 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.288064 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.288186 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.288372 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.288494 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.288698 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.288831 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.289007 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.289132 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.289316 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.289440 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.289625 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.289749 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.289928 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.290051 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.290234 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.290368 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.290537 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.290661 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.290881 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.291004 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.291187 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.291355 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.291555 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.291679 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.291866 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.291994 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.292215 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.292353 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.292528 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.292652 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.292861 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.292995 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.293178 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.293315 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.293487 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.293624 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.293801 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.293962 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.294085 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.294297 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.294418 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.294546 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.294704 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.294829 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.295020 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.295214 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.295361 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.295499 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.295670 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.295794 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.295995 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.296122 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.296308 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.296433 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.296634 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.296768 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.296939 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.297114 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.297277 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.297398 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.297585 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.297729 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.297901 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.298037 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.298209 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.298336 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.298522 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.298642 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.298826 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.298950 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.299141 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.299264 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.299476 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.299600 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.299788 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.299912 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.300099 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.300225 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.300410 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.300547 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.300721 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.300861 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.301035 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.301203 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.301324 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.301468 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.301637 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.301774 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.301947 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.302069 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.302256 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.302394 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.302574 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.302699 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.302878 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.303011 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.303191 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.303353 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.303544 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.303667 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.303867 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.304000 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.304198 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.304324 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.304513 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.304636 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.304835 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.304959 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.305149 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.305332 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.305455 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.305585 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.305753 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.305888 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.306058 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.306192 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.306364 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.306490 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.306675 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.306798 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.306988 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.307122 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.307363 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.307493 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.307621 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.307820 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.307945 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.308069 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.308224 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.308349 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.308539 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.308691 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.308838 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.308960 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.309144 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.309268 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.309458 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.309595 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.309771 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.309893 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.310081 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.310217 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.310390 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.310527 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.310708 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.310863 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.311034 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.311166 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.311370 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.311520 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.311703 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.311836 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.312015 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.312190 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.312324 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.312455 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.312611 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.312746 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.312918 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.313043 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.313265 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.313392 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.313592 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.313714 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.313871 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.314005 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.314188 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.314324 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.314511 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.314634 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.314823 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.314960 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.315141 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.315263 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.315511 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.315633 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.315760 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.315902 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.316079 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.316215 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.316402 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.316536 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.316712 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.316869 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.317017 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.317142 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.317319 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.317443 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.317629 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.317773 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.317957 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.318078 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.318239 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.318364 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.318586 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.318775 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.318897 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.319033 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.319197 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.319355 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.319510 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.319632 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.320374 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.320498 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.320694 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.320831 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.321010 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.321275 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.321410 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.321613 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.321736 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.321931 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.322068 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.322256 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.322513 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.322639 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.322856 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.322981 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.323178 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.323337 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.323528 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.323653 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.323856 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.324060 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.324197 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.324338 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.324469 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.324604 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.324752 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.324877 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.325059 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.325196 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.325369 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.325505 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.325682 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.325803 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.325967 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.326093 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.326272 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.326396 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.326581 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.326706 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.326889 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.327028 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.327192 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.327342 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.327523 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.327663 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.327828 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.327966 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.328139 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.328260 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.328434 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.328559 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.328741 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.328931 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.329052 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.329183 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.329351 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.329488 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.329658 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.329794 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.330025 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.330156 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.330294 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.330419 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.330556 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.330676 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.330880 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.331038 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.331163 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.331287 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.331503 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.331627 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.331810 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.331935 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.332160 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.332295 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.332480 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.332613 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.332751 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.332887 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.333064 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.333210 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.333385 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.333512 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.333642 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.333782 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.333946 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.334084 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.334255 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.334379 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.334563 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.334688 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.334865 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.335011 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.335175 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.335333 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.336110 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.336243 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.336422 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.336567 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.336731 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.336864 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.337041 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.337164 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.337352 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.337475 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.337655 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.337777 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.337966 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.338090 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.338273 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.338405 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.338564 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.338690 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.338868 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.339046 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.339186 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.339340 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.339496 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.339620 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.339800 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.339924 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.340109 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.340233 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.340437 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.340565 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.340757 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.340894 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.341067 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.341189 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.341353 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.341479 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.341656 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.341793 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.341964 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.342089 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.342271 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.342394 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.342584 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.342719 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.342881 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.343007 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.343192 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.343391 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.343517 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.343664 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.343809 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.343935 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.344117 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.344244 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.344420 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.344558 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.344723 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.344847 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.345028 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.345161 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.345341 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.345477 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.345647 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.345772 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.345946 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.346082 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.346259 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.346391 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.346557 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.346682 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.346865 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.346989 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.347170 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.347399 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.347522 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.347648 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.347791 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.347993 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.348126 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.348249 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.348375 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.348499 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.348648 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.348798 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.348950 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.349076 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.349274 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.349401 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.349582 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.349720 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.349883 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.350006 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.350185 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.350307 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.350484 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.350619 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.350807 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.350930 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.351144 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.351293 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.351467 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.351590 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.351776 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.351912 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.352122 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.352247 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.352437 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.352583 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.352761 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.352894 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.353021 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.353149 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.353340 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.353465 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.353644 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.353769 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.353961 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.354084 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.354255 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.354391 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.354568 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.354692 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.354872 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.354996 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.355175 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.355345 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.355527 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.355719 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.355856 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.355995 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.356117 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.356251 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.356436 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.356560 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.356735 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.356873 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.357051 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.357186 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.357358 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.357493 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.357669 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.357816 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.357981 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.358105 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.358291 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.358414 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.358598 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.358735 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.358907 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.359033 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.359223 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.359397 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.359553 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.359674 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.359854 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.360028 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.360154 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.360286 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.360462 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.360598 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.360771 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.360901 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.361081 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.361206 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.361396 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.361569 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.361692 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.361818 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.361989 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.362155 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.362299 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.362419 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.362588 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.362713 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.362905 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.363048 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.363207 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.363355 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.363543 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.363667 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.363849 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.363985 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.364247 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.364381 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.364556 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.364681 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.364872 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.365017 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.365177 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.365298 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.365482 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.365618 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.365800 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.365958 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.366119 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.366353 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.366477 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.366601 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.366760 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.366895 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.367134 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.367259 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.367482 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.367609 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.367801 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.367935 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.368111 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.368236 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.368848 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.368973 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.369166 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.369291 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.369483 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.369607 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.369808 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.369932 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.370118 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.370241 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.370426 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.370551 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.370996 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.371133 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.371348 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.371532 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.371654 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.371784 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.371969 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.372122 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.372312 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.372450 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.372642 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.372767 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.372952 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.373089 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.373279 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.373415 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.373687 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.373810 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.374000 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.374140 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.374307 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.374431 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.374637 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.374761 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.374962 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.375099 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.375269 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.375456 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.375598 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.375722 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.375912 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.376091 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.376234 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.376369 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.376550 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.376733 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.376855 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.376983 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.377170 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.377295 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.377475 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.377600 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.377800 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.377927 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.378122 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.378326 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.378448 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.378575 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.378732 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.378857 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.379062 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.379237 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.379414 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.379599 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.379740 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.379899 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.380051 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.380224 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.380468 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.380594 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.380795 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.380932 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.381111 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.381236 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.381437 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.381563 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.381743 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.381882 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.382049 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.382192 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.382876 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.383012 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.383195 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.383364 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.383532 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.383658 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.383845 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.383970 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.384152 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.384275 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.384457 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.384583 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.384764 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.384890 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.385076 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.385211 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.385379 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.385502 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.385684 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.385807 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.386096 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.386224 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.386353 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.386489 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.386612 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.386739 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.386927 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.387055 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.387250 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.387456 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.387577 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.387724 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.387887 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.388013 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.388195 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.388320 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.388502 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.388686 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.388850 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.388977 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.389158 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.389284 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.389482 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.389627 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.389803 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.389924 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.390136 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.390261 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.390446 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.390582 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.390787 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.390908 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.391091 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.391217 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.391435 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.391560 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.391761 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.391908 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.392084 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.392211 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.392390 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.392516 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.392693 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.392818 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.393005 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.393142 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.393311 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.393436 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.393619 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.393743 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.393927 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.394067 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.394221 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.394344 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.394520 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.394645 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.394823 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.394961 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.395126 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.395270 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.395461 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.395597 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.395768 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.395974 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.396107 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.396295 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.396418 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.396547 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.396673 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.396818 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.396990 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.397113 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.397289 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.397424 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.397593 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.397734 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.397981 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.398595 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.398781 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.398919 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.399090 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.399215 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.399461 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.399584 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.399769 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.399962 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.400097 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.400220 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.400405 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.400530 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.400722 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.400865 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.401058 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.401237 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.401359 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.401491 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.401653 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.401781 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.401966 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.402089 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.402270 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.402395 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.402588 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.402729 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.402895 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.403021 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.403214 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.403387 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.403553 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.403754 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.403878 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.404018 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.404257 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.404429 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.404579 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.404763 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.404888 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.405080 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.405207 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.405395 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.405706 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.405845 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.406022 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.406163 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.406340 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.406517 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.406651 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.406777 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.406949 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.407133 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.407256 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.407414 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.407589 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.407752 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.407935 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.408105 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.408255 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.408378 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.408516 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.408639 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.408824 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.408960 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.409159 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.409296 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.409480 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.409607 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.409805 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.409929 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.410163 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.410307 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.410482 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.410608 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.410808 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.410944 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.411124 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.411248 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.411467 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.411608 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.411783 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.411907 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.412097 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.412221 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.412399 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.412526 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.412709 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.412855 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.413022 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.413147 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.413338 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.413476 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.413685 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.413836 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.413997 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.414135 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.414311 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.414445 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.414623 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.414765 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.414934 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.415056 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.415248 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.415529 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.415671 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.415813 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.415955 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.416169 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.416295 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.416539 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.416685 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.416862 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.416988 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.417184 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.417416 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.417548 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.417741 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.417877 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.418082 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.418327 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.418452 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.418648 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.418785 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.418989 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.419114 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.419392 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.419523 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.419669 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.419794 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.419984 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.420110 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.420291 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.420424 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.420628 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.420755 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.420943 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.421069 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.421254 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.421378 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.421570 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.421696 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.421893 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.422069 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.422247 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.422382 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.422519 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.422672 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.422796 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.423194 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.423343 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.423688 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.423812 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.424012 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.424343 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.424473 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.424672 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.424905 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.425030 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.425289 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.425615 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.425888 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.426014 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.426215 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.426525 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.426706 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.426833 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.427113 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.427239 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.427513 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.427746 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.427872 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.428055 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.428343 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.428480 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.428657 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.428956 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.429082 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.429341 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.429466 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.429653 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.429913 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.430048 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.430251 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.430427 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.430549 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.430694 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.430854 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.430979 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.431159 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.431296 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.431487 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.431624 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.431785 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.431910 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.432131 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.432286 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.432430 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.432616 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.432754 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.432937 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.433062 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.433259 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.433414 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.433576 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.433702 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.433908 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.434032 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.434222 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.434358 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.434579 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.434711 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.434888 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.435020 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.435187 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.435451 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.435576 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.435705 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.435836 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.435961 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.436145 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.436271 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.436462 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.436608 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.436775 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.436957 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.437105 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.437228 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.437425 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.437616 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.437738 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.437979 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.438117 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.438315 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.438441 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.438638 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.438764 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.438975 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.439118 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.439328 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.439476 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.439640 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.439768 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.439948 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.440087 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.440255 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.440380 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.440580 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.440708 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.440893 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.441018 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.441204 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.441348 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.441515 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.441642 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.441823 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.441949 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.442134 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.442282 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.442445 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.442717 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.442855 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.443047 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.443335 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.443485 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.443685 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.443824 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.443993 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.444120 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.444347 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.444528 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.444658 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.445324 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.445466 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.445606 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.445815 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.445941 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.446135 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.446273 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.446452 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.446578 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.446767 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.446894 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.447086 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.447212 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.447401 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.447525 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.447714 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.447838 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.447984 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.448121 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.448299 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.448425 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.448615 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.448742 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.448944 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.449078 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.449259 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.449396 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.449563 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.449698 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.449932 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.450056 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.450248 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.450374 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.450573 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.450712 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.450925 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.451062 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.451251 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.451391 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.451625 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.451770 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.451947 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.452073 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.452274 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.452431 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.452625 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.452755 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.452897 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.453033 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.453191 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.453315 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.453509 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.453636 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.453832 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.453958 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.454158 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.454284 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.454466 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.454592 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.454772 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.454909 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.455077 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.455272 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.455530 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.455658 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.455799 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.455925 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.456051 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.456247 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.456384 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.456563 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.456690 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.456889 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.457014 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.457206 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.457328 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.457482 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.457620 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.457790 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.457933 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.458090 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.458214 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.458402 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.458530 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.458703 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.458841 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.459005 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.459161 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.459288 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.459526 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.459653 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.459840 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.459966 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.460137 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.460261 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.460499 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.461134 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.461325 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.461459 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.461650 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.461778 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.461967 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.462093 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.462411 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.462606 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.462791 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.462914 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.462914 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.463178 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.463367 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.463507 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.463630 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.463755 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.463881 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.464019 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.464154 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.464278 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.464406 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.464541 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.464665 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.464809 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.464968 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.465105 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.465276 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.465403 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.465584 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.465788 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.465912 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.466040 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.466212 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.466336 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.466557 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.466682 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.466872 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.466998 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.467187 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.467403 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.467538 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.467673 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.467806 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.467986 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.468109 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.468247 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.468435 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.468560 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.468760 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.468896 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.469068 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.469207 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.469393 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.469528 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.469708 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.469842 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.470027 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.470163 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.470337 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.470461 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.470647 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.470771 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.470976 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.471118 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.471284 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.471439 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.471614 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.471756 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.471932 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.472072 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.472241 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.472367 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.472649 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.472785 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.472978 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.473113 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.473244 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.473384 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.473510 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.473638 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.473777 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.473912 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.474085 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.474211 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.474410 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.474544 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.474736 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.474872 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.475066 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.475190 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.475414 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.475562 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.475740 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.475863 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.476083 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.476211 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.476402 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.476540 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.476722 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.476846 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.477027 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.477162 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.477284 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 01 04:18:28.477478 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.477647 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.477966 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.478279 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.478600 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.478921 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.479251 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.479617 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.479932 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.480263 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.480594 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.480947 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.481263 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.481614 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.481947 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.482266 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.482583 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.482894 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:18:28.483140 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 01 04:18:28.537045 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO dbcounter [None req-7a0621cc-bbb0-4cdd-875c-c9d4a348c0d0 None None] Registered counter for database nova_api Jun 01 04:18:28.543480 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO dbcounter [None req-4d0731fe-9ada-4618-85b4-47f846fd6e77 None None] Registered counter for database nova_api Jun 01 04:18:28.558645 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG oslo_db.sqlalchemy.engines [None req-7a0621cc-bbb0-4cdd-875c-c9d4a348c0d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103909) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 01 04:18:28.564674 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG oslo_db.sqlalchemy.engines [None req-4d0731fe-9ada-4618-85b4-47f846fd6e77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 01 04:18:28.566277 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG dbcounter [-] [103909] Writer thread running {{(pid=103909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 01 04:18:28.573003 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG dbcounter [-] [103908] Writer thread running {{(pid=103908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 01 04:18:28.624190 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.context [None req-7a0621cc-bbb0-4cdd-875c-c9d4a348c0d0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f8c01473-0ed5-4371-bff6-91e2cece601b(cell1) {{(pid=103909) load_cells /opt/stack/nova/nova/context.py:464}} Jun 01 04:18:28.628038 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG oslo_concurrency.lockutils [None req-7a0621cc-bbb0-4cdd-875c-c9d4a348c0d0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:18:28.629492 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.context [None req-4d0731fe-9ada-4618-85b4-47f846fd6e77 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f8c01473-0ed5-4371-bff6-91e2cece601b(cell1) {{(pid=103908) load_cells /opt/stack/nova/nova/context.py:464}} Jun 01 04:18:28.629643 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG oslo_concurrency.lockutils [None req-7a0621cc-bbb0-4cdd-875c-c9d4a348c0d0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:18:28.630455 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG oslo_concurrency.lockutils [None req-7a0621cc-bbb0-4cdd-875c-c9d4a348c0d0 None None] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:18:28.633092 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG oslo_concurrency.lockutils [None req-7a0621cc-bbb0-4cdd-875c-c9d4a348c0d0 None None] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:18:28.634242 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG oslo_concurrency.lockutils [None req-4d0731fe-9ada-4618-85b4-47f846fd6e77 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:18:28.635121 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO dbcounter [None req-7a0621cc-bbb0-4cdd-875c-c9d4a348c0d0 None None] Registered counter for database nova_cell0 Jun 01 04:18:28.635840 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG oslo_concurrency.lockutils [None req-4d0731fe-9ada-4618-85b4-47f846fd6e77 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:18:28.636636 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG oslo_concurrency.lockutils [None req-4d0731fe-9ada-4618-85b4-47f846fd6e77 None None] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:18:28.638608 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG oslo_concurrency.lockutils [None req-4d0731fe-9ada-4618-85b4-47f846fd6e77 None None] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:18:28.639320 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO dbcounter [None req-7a0621cc-bbb0-4cdd-875c-c9d4a348c0d0 None None] Registered counter for database nova_cell1 Jun 01 04:18:28.640648 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO dbcounter [None req-4d0731fe-9ada-4618-85b4-47f846fd6e77 None None] Registered counter for database nova_cell0 Jun 01 04:18:28.644808 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO dbcounter [None req-4d0731fe-9ada-4618-85b4-47f846fd6e77 None None] Registered counter for database nova_cell1 Jun 01 04:18:28.646645 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG oslo_db.sqlalchemy.engines [None req-7a0621cc-bbb0-4cdd-875c-c9d4a348c0d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103909) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 01 04:18:28.648961 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG oslo_db.sqlalchemy.engines [None req-7a0621cc-bbb0-4cdd-875c-c9d4a348c0d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103909) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 01 04:18:28.652245 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG oslo_db.sqlalchemy.engines [None req-4d0731fe-9ada-4618-85b4-47f846fd6e77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 01 04:18:28.653945 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG oslo_db.sqlalchemy.engines [None req-4d0731fe-9ada-4618-85b4-47f846fd6e77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 01 04:18:28.655021 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG dbcounter [-] [103909] Writer thread running {{(pid=103909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 01 04:18:28.657102 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG dbcounter [-] [103909] Writer thread running {{(pid=103909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 01 04:18:28.660365 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG dbcounter [-] [103908] Writer thread running {{(pid=103908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 01 04:18:28.661647 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG dbcounter [-] [103908] Writer thread running {{(pid=103908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 01 04:18:28.803490 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO dbcounter [None req-7a0621cc-bbb0-4cdd-875c-c9d4a348c0d0 None None] Registered counter for database nova_cell0 Jun 01 04:18:28.809870 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO dbcounter [None req-4d0731fe-9ada-4618-85b4-47f846fd6e77 None None] Registered counter for database nova_cell0 Jun 01 04:18:28.814199 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG oslo_db.sqlalchemy.engines [None req-7a0621cc-bbb0-4cdd-875c-c9d4a348c0d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103909) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 01 04:18:28.818802 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG dbcounter [-] [103909] Writer thread running {{(pid=103909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 01 04:18:28.825634 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG oslo_db.sqlalchemy.engines [None req-4d0731fe-9ada-4618-85b4-47f846fd6e77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 01 04:18:28.832044 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG dbcounter [-] [103908] Writer thread running {{(pid=103908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 01 04:18:29.382664 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: WARNING keystonemiddleware.auth_token [None req-7a0621cc-bbb0-4cdd-875c-c9d4a348c0d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 01 04:18:29.390476 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: WARNING keystonemiddleware.auth_token [None req-7a0621cc-bbb0-4cdd-875c-c9d4a348c0d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 01 04:18:29.517224 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: WARNING keystonemiddleware.auth_token [None req-4d0731fe-9ada-4618-85b4-47f846fd6e77 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 01 04:18:29.525108 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: WARNING keystonemiddleware.auth_token [None req-4d0731fe-9ada-4618-85b4-47f846fd6e77 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 01 04:18:29.616094 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: WARNING keystonemiddleware.auth_token [None req-7a0621cc-bbb0-4cdd-875c-c9d4a348c0d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 01 04:18:29.622452 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: WARNING keystonemiddleware.auth_token [None req-7a0621cc-bbb0-4cdd-875c-c9d4a348c0d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 01 04:18:29.627628 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5575ce39a9c0 pid: 103909 (default app) Jun 01 04:18:29.629997 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-7a0621cc-bbb0-4cdd-875c-c9d4a348c0d0 None None] Calling method '>' {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:18:29.631188 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-7a0621cc-bbb0-4cdd-875c-c9d4a348c0d0 None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002010 Jun 01 04:18:29.631641 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Wed Jun 1 04:18:29 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:18:29.747981 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: WARNING keystonemiddleware.auth_token [None req-4d0731fe-9ada-4618-85b4-47f846fd6e77 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 01 04:18:29.753929 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: WARNING keystonemiddleware.auth_token [None req-4d0731fe-9ada-4618-85b4-47f846fd6e77 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 01 04:18:29.759717 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5575ce39a9c0 pid: 103908 (default app) Jun 01 04:19:53.362326 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-7a0621cc-bbb0-4cdd-875c-c9d4a348c0d0 None None] Calling method '>' {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:19:53.363629 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-7a0621cc-bbb0-4cdd-875c-c9d4a348c0d0 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001696 Jun 01 04:19:53.365893 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 1 04:19:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:19:53.379281 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG dbcounter [-] [103908] Writing DB stats nova_api:SELECT=3 {{(pid=103908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:19:53.380595 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG dbcounter [-] [103908] Writing DB stats nova_cell1:SELECT=3 {{(pid=103908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:19:53.382056 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG dbcounter [-] [103908] Writing DB stats nova_cell0:SELECT=3 {{(pid=103908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:19:53.382969 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG dbcounter [-] [103908] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:19:53.817980 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-45b63665-abe4-4a95-a106-5fc9ffacd056 admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:19:53.858354 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-45b63665-abe4-4a95-a106-5fc9ffacd056 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.484600 Jun 01 04:19:53.859087 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 1/3] 10.222.0.18 () {60 vars in 1291 bytes} [Wed Jun 1 04:19:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:19:56.233066 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-7a0621cc-bbb0-4cdd-875c-c9d4a348c0d0 None None] Calling method '>' {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:19:56.234053 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-7a0621cc-bbb0-4cdd-875c-c9d4a348c0d0 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jun 01 04:19:56.234616 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 3/4] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 1 04:19:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:19:56.299378 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-2d65a664-c891-4b0e-8ec0-dd163e3ada74 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "rxtx_factor": 1.0, "name": "cirros256", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "id": "c1"}} {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:19:56.320025 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 01 04:19:56.320025 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: warnings.warn(msg) Jun 01 04:19:56.409623 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-2d65a664-c891-4b0e-8ec0-dd163e3ada74 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.168833 Jun 01 04:19:56.410614 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 2/5] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jun 1 04:19:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 01 04:19:56.424471 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG dbcounter [-] [103909] Writing DB stats nova_api:SELECT=3 {{(pid=103909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:19:56.426184 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG dbcounter [-] [103909] Writing DB stats nova_cell1:SELECT=3 {{(pid=103909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:19:56.427115 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG dbcounter [-] [103909] Writing DB stats nova_cell0:SELECT=3 {{(pid=103909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:19:56.428710 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG dbcounter [-] [103909] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:19:56.648432 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-e875ff80-949e-4974-bfb9-b200632296b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:19:56.650956 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 01 04:19:56.650956 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: warnings.warn(msg) Jun 01 04:19:56.767604 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-e875ff80-949e-4974-bfb9-b200632296b2 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.348818 Jun 01 04:19:56.768452 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 4/6] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Jun 1 04:19:56 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:19:59.121623 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-2d65a664-c891-4b0e-8ec0-dd163e3ada74 admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:19:59.122657 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-2d65a664-c891-4b0e-8ec0-dd163e3ada74 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 01 04:19:59.123340 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 3/7] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 1 04:19:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:19:59.260418 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-914077a4-4ce6-4b8d-a911-076b621c83dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "name": "ds512M", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d1", "ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:19:59.278934 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 01 04:19:59.278934 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: warnings.warn(msg) Jun 01 04:19:59.378287 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-914077a4-4ce6-4b8d-a911-076b621c83dd admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.248713 Jun 01 04:19:59.378774 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 5/8] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jun 1 04:19:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 01 04:19:59.391228 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-6f30b7de-f282-4032-8910-aa85dc780ec7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:19:59.392752 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 01 04:19:59.392752 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: warnings.warn(msg) Jun 01 04:19:59.520066 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-6f30b7de-f282-4032-8910-aa85dc780ec7 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.132259 Jun 01 04:19:59.520677 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 4/9] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Jun 1 04:19:59 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:20:01.901153 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-914077a4-4ce6-4b8d-a911-076b621c83dd admin admin] Calling method '>' {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:01.902099 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-914077a4-4ce6-4b8d-a911-076b621c83dd admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jun 01 04:20:01.902504 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 1 04:20:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:20:01.969831 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-190f3cba-cb5c-4257-b9f1-e77ed653f35a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "name": "ds1G", "os-flavor-access:is_public": true, "ram": 1024, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "rxtx_factor": 1.0}} {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:20:02.044397 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-190f3cba-cb5c-4257-b9f1-e77ed653f35a admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.135759 Jun 01 04:20:02.044947 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 5/11] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jun 1 04:20:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 01 04:20:02.059462 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-0bca994d-64ad-4e8d-8302-0d8b251ae860 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:20:02.148985 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-0bca994d-64ad-4e8d-8302-0d8b251ae860 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094885 Jun 01 04:20:02.149607 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 7/12] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Jun 1 04:20:02 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:20:04.498190 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-190f3cba-cb5c-4257-b9f1-e77ed653f35a admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:04.499218 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-190f3cba-cb5c-4257-b9f1-e77ed653f35a admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 01 04:20:04.499648 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 6/13] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 1 04:20:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:20:04.568913 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-0d3c2c74-36c6-4c27-bc02-45562e61f369 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0, "ram": 2048, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "name": "ds2G"}} {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:20:04.636154 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-0d3c2c74-36c6-4c27-bc02-45562e61f369 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.125494 Jun 01 04:20:04.636991 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 8/14] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jun 1 04:20:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 01 04:20:04.651361 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-f15f98d6-d1c2-421a-94b5-ce1947be71b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:20:04.753261 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-f15f98d6-d1c2-421a-94b5-ce1947be71b6 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107190 Jun 01 04:20:04.753834 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 7/15] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Jun 1 04:20:04 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:20:07.118991 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-0d3c2c74-36c6-4c27-bc02-45562e61f369 admin admin] Calling method '>' {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:07.120081 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-0d3c2c74-36c6-4c27-bc02-45562e61f369 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001806 Jun 01 04:20:07.120490 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 9/16] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 1 04:20:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:20:07.187756 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-de10a620-4b49-4652-aa3c-669ed1859dc7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "d4", "name": "ds4G", "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:20:07.275604 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-de10a620-4b49-4652-aa3c-669ed1859dc7 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.148657 Jun 01 04:20:07.276200 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 8/17] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jun 1 04:20:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 01 04:20:07.289400 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-6486f802-34b8-47c4-b884-bf16a62b0927 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:20:07.378822 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-6486f802-34b8-47c4-b884-bf16a62b0927 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094122 Jun 01 04:20:07.379610 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 10/18] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Jun 1 04:20:07 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:20:09.723423 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-de10a620-4b49-4652-aa3c-669ed1859dc7 admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:09.724483 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-de10a620-4b49-4652-aa3c-669ed1859dc7 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Jun 01 04:20:09.724901 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 9/19] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 1 04:20:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:20:09.793622 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-e216f458-0287-46c7-9c5e-a24bf550e55d admin admin] Calling method '>' {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:09.832264 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-e216f458-0287-46c7-9c5e-a24bf550e55d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.100239 Jun 01 04:20:09.832819 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 11/20] 10.222.0.18 () {60 vars in 1291 bytes} [Wed Jun 1 04:20:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:20:12.398614 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-de10a620-4b49-4652-aa3c-669ed1859dc7 admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:12.399928 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-de10a620-4b49-4652-aa3c-669ed1859dc7 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001823 Jun 01 04:20:12.400334 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 10/21] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 1 04:20:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:20:12.476593 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-9ee3178a-ef1c-4ab0-b597-2384c33810b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "1", "vcpus": 1}} {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:20:12.554612 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-9ee3178a-ef1c-4ab0-b597-2384c33810b6 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.146948 Jun 01 04:20:12.555171 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 12/22] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jun 1 04:20:12 2022] POST /compute/v2.1/flavors => generated 402 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 01 04:20:12.568761 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-ba6c653e-1729-4ea4-adc6-18b4a90d71fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:20:12.650612 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-ba6c653e-1729-4ea4-adc6-18b4a90d71fe admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086310 Jun 01 04:20:12.651200 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 11/23] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Jun 1 04:20:12 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:20:15.044029 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-9ee3178a-ef1c-4ab0-b597-2384c33810b6 admin admin] Calling method '>' {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:15.045049 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-9ee3178a-ef1c-4ab0-b597-2384c33810b6 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Jun 01 04:20:15.045463 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 1 04:20:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:20:15.111688 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-ce0f1218-464c-4c77-8941-2bc592aab605 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "2", "disk": 20, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "name": "m1.small", "vcpus": 1}} {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:20:15.215460 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-ce0f1218-464c-4c77-8941-2bc592aab605 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.162812 Jun 01 04:20:15.216172 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 12/25] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jun 1 04:20:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 01 04:20:15.232279 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-17d23b1d-fe1f-4f2b-92ec-42ad985992d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:20:15.301598 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-17d23b1d-fe1f-4f2b-92ec-42ad985992d7 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073024 Jun 01 04:20:15.302328 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 14/26] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Jun 1 04:20:15 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:20:17.765080 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-ce0f1218-464c-4c77-8941-2bc592aab605 admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:17.766106 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-ce0f1218-464c-4c77-8941-2bc592aab605 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jun 01 04:20:17.766500 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 13/27] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 1 04:20:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:20:17.832441 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-c8a321d9-8bb2-406b-a939-c5197cf68079 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "os-flavor-access:is_public": true, "id": "3", "name": "m1.medium", "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2}} {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:20:17.929456 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-c8a321d9-8bb2-406b-a939-c5197cf68079 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.156663 Jun 01 04:20:17.930282 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 15/28] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jun 1 04:20:17 2022] POST /compute/v2.1/flavors => generated 406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 01 04:20:17.942349 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-fef8dabf-3203-45a9-b044-3d56403d84cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:20:18.022499 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-fef8dabf-3203-45a9-b044-3d56403d84cb admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083850 Jun 01 04:20:18.023481 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 14/29] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Jun 1 04:20:17 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:20:20.324594 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-c8a321d9-8bb2-406b-a939-c5197cf68079 admin admin] Calling method '>' {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:20.325586 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-c8a321d9-8bb2-406b-a939-c5197cf68079 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jun 01 04:20:20.325987 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 16/30] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 1 04:20:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:20:20.385769 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-7aaeed3a-7ac1-4f41-a59d-08d48721b121 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "name": "m1.large", "os-flavor-access:is_public": true, "id": "4", "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:20:20.479229 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-7aaeed3a-7ac1-4f41-a59d-08d48721b121 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.147146 Jun 01 04:20:20.479761 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 15/31] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jun 1 04:20:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 01 04:20:20.492401 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-581bcdac-2e7f-4ef8-a46c-f8ad30fb12d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:20:20.680989 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-581bcdac-2e7f-4ef8-a46c-f8ad30fb12d4 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.192877 Jun 01 04:20:20.681579 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 17/32] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Jun 1 04:20:20 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:20:23.096526 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-7aaeed3a-7ac1-4f41-a59d-08d48721b121 admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:23.097571 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-7aaeed3a-7ac1-4f41-a59d-08d48721b121 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jun 01 04:20:23.098012 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 16/33] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 1 04:20:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:20:23.164647 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-13af4bfb-3c99-45fe-865c-b346e5db1ef1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.xlarge", "rxtx_factor": 1.0, "vcpus": 8, "disk": 160, "os-flavor-access:is_public": true}} {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:20:23.256238 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-13af4bfb-3c99-45fe-865c-b346e5db1ef1 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.151695 Jun 01 04:20:23.256980 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 18/34] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jun 1 04:20:23 2022] POST /compute/v2.1/flavors => generated 408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 01 04:20:23.268892 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-82933197-82e6-4501-b553-234ef923a015 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:20:23.379883 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-82933197-82e6-4501-b553-234ef923a015 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114509 Jun 01 04:20:23.382560 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 17/35] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Jun 1 04:20:23 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:20:47.875619 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-13af4bfb-3c99-45fe-865c-b346e5db1ef1 admin admin] Calling method '>' {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:47.876620 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-13af4bfb-3c99-45fe-865c-b346e5db1ef1 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jun 01 04:20:47.877069 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 19/36] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 1 04:20:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:20:47.887984 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG dbcounter [-] [103908] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:20:47.935643 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-d4e50c2f-46ba-4196-9c30-187321176701 admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:47.953039 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-d4e50c2f-46ba-4196-9c30-187321176701 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069503 Jun 01 04:20:47.953572 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 18/37] 10.222.0.18 () {60 vars in 1291 bytes} [Wed Jun 1 04:20:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:20:48.962130 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-13af4bfb-3c99-45fe-865c-b346e5db1ef1 admin admin] Calling method '>' {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:48.963163 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-13af4bfb-3c99-45fe-865c-b346e5db1ef1 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jun 01 04:20:48.963690 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 20/38] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 1 04:20:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:20:49.159546 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-d6b3524c-3f7d-454e-9008-89c5467220df admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:49.166042 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.wsgi [None req-d6b3524c-3f7d-454e-9008-89c5467220df admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 01 04:20:49.169297 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-d6b3524c-3f7d-454e-9008-89c5467220df admin admin] Request method failure captured: Jun 01 04:20:49.169297 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 01 04:20:49.169297 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: Accept: application/json Jun 01 04:20:49.169297 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: Accept-Encoding: gzip, deflate Jun 01 04:20:49.169297 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: Connection: keep-alive Jun 01 04:20:49.169297 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: Content-Length: 0 Jun 01 04:20:49.169297 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: Host: 10.222.0.18 Jun 01 04:20:49.169297 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: Openstack-Api-Version: compute 2.90 Jun 01 04:20:49.169297 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: Openstack-System-Scope: None Jun 01 04:20:49.169297 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: User-Agent: python-novaclient Jun 01 04:20:49.169297 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Auth-Token: gAAAAABilukgnzCroDeIw_RqwhhRgktvtL6Umt8XIYKPaBX1_0PJ4fo3bkhG0wk5ve-N5I19SzOHcfPcP34lntzQlyrHV6KJuzAgQm4AkoVlucJLEEyqZULm26iIYgSl5nrDX7Rsa5EZrfFTquEM5_kjVuardgX258QvbbGYJ7sNuSOiig5i_jo Jun 01 04:20:49.169297 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Domain-Id: None Jun 01 04:20:49.169297 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Domain-Name: None Jun 01 04:20:49.169297 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Identity-Status: Confirmed Jun 01 04:20:49.169297 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Is-Admin-Project: True Jun 01 04:20:49.169297 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Openstack-Nova-Api-Version: 2.90 Jun 01 04:20:49.169297 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Project-Domain-Id: default Jun 01 04:20:49.169297 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Project-Domain-Name: Default Jun 01 04:20:49.169297 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Project-Id: efd554ba71f4463abb4c78dc3cafe52a Jun 01 04:20:49.169297 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Project-Name: admin Jun 01 04:20:49.169297 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Role: reader,member,admin Jun 01 04:20:49.169297 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Roles: reader,member,admin Jun 01 04:20:49.171037 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/efd554ba71f4463abb4c78dc3cafe52a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_efd554ba71f4463abb4c78dc3cafe52a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/efd554ba71f4463abb4c78dc3cafe52a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/efd554ba71f4463abb4c78dc3cafe52a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:20:49.171037 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Tenant: admin Jun 01 04:20:49.171037 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Tenant-Id: efd554ba71f4463abb4c78dc3cafe52a Jun 01 04:20:49.171037 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Tenant-Name: admin Jun 01 04:20:49.171037 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-User: admin Jun 01 04:20:49.171037 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-User-Domain-Id: default Jun 01 04:20:49.171037 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-User-Domain-Name: Default Jun 01 04:20:49.171037 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-User-Id: c2efe34f830a400eb5eb8876be2a1da6 Jun 01 04:20:49.171037 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-User-Name: admin Jun 01 04:20:49.171037 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: method: > Jun 01 04:20:49.171037 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: exception: Flavor 42 could not be found. Jun 01 04:20:49.171037 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: action_args: {'id': '42'} Jun 01 04:20:49.171037 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:20:49.171037 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:20:49.171982 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 01 04:20:49.171982 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 01 04:20:49.171982 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 01 04:20:49.171982 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 01 04:20:49.171982 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 01 04:20:49.171982 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 01 04:20:49.171982 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 01 04:20:49.171982 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 01 04:20:49.171982 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 01 04:20:49.171982 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:20:49.171982 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 01 04:20:49.171982 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 01 04:20:49.171982 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 01 04:20:49.171982 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Jun 01 04:20:49.171982 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:20:49.171982 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Jun 01 04:20:49.171982 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:20:49.171982 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:20:49.171982 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:20:49.173115 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:20:49.173115 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:20:49.173115 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:20:49.173115 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:20:49.173115 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 01 04:20:49.173115 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:20:49.173115 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 01 04:20:49.173115 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Jun 01 04:20:49.173115 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:20:49.173115 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Jun 01 04:20:49.173115 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:20:49.173115 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:20:49.173115 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:20:49.173115 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:20:49.173115 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:20:49.173115 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 01 04:20:49.173115 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Jun 01 04:20:49.173115 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-d6b3524c-3f7d-454e-9008-89c5467220df admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:20:49.174307 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-d6b3524c-3f7d-454e-9008-89c5467220df admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.064363 Jun 01 04:20:49.174307 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 19/39] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Jun 1 04:20:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 01 04:20:49.181215 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-c8b1bf66-c60d-4948-8f4b-eadf7fb15bae admin admin] Calling method '>' {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:49.184258 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG dbcounter [-] [103909] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:20:49.202988 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-c8b1bf66-c60d-4948-8f4b-eadf7fb15bae admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025385 Jun 01 04:20:49.203585 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 21/40] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Jun 1 04:20:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:20:49.213381 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-a6256130-54eb-452c-bc2b-09382889c3b6 admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:49.235514 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-a6256130-54eb-452c-bc2b-09382889c3b6 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025640 Jun 01 04:20:49.236076 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 20/41] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Jun 1 04:20:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:20:49.246568 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-560e9a3d-ef01-41fa-826c-58f65b556cb8 admin admin] Calling method '>' {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:49.252658 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.wsgi [None req-560e9a3d-ef01-41fa-826c-58f65b556cb8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 01 04:20:49.256028 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-560e9a3d-ef01-41fa-826c-58f65b556cb8 admin admin] Request method failure captured: Jun 01 04:20:49.256028 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 01 04:20:49.256028 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: Accept: application/json Jun 01 04:20:49.256028 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: Accept-Encoding: gzip, deflate Jun 01 04:20:49.256028 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: Connection: keep-alive Jun 01 04:20:49.256028 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: Content-Length: 0 Jun 01 04:20:49.256028 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: Host: 10.222.0.18 Jun 01 04:20:49.256028 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: Openstack-Api-Version: compute 2.90 Jun 01 04:20:49.256028 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: Openstack-System-Scope: None Jun 01 04:20:49.256028 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: User-Agent: python-novaclient Jun 01 04:20:49.256028 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Auth-Token: gAAAAABilukgnzCroDeIw_RqwhhRgktvtL6Umt8XIYKPaBX1_0PJ4fo3bkhG0wk5ve-N5I19SzOHcfPcP34lntzQlyrHV6KJuzAgQm4AkoVlucJLEEyqZULm26iIYgSl5nrDX7Rsa5EZrfFTquEM5_kjVuardgX258QvbbGYJ7sNuSOiig5i_jo Jun 01 04:20:49.256028 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Domain-Id: None Jun 01 04:20:49.256028 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Domain-Name: None Jun 01 04:20:49.256028 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Identity-Status: Confirmed Jun 01 04:20:49.256028 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Is-Admin-Project: True Jun 01 04:20:49.256028 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Openstack-Nova-Api-Version: 2.90 Jun 01 04:20:49.256028 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Project-Domain-Id: default Jun 01 04:20:49.256028 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Project-Domain-Name: Default Jun 01 04:20:49.256028 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Project-Id: efd554ba71f4463abb4c78dc3cafe52a Jun 01 04:20:49.256028 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Project-Name: admin Jun 01 04:20:49.256028 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Role: reader,member,admin Jun 01 04:20:49.256028 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Roles: reader,member,admin Jun 01 04:20:49.257730 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/efd554ba71f4463abb4c78dc3cafe52a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_efd554ba71f4463abb4c78dc3cafe52a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/efd554ba71f4463abb4c78dc3cafe52a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/efd554ba71f4463abb4c78dc3cafe52a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:20:49.257730 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Tenant: admin Jun 01 04:20:49.257730 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Tenant-Id: efd554ba71f4463abb4c78dc3cafe52a Jun 01 04:20:49.257730 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Tenant-Name: admin Jun 01 04:20:49.257730 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-User: admin Jun 01 04:20:49.257730 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-User-Domain-Id: default Jun 01 04:20:49.257730 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-User-Domain-Name: Default Jun 01 04:20:49.257730 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-User-Id: c2efe34f830a400eb5eb8876be2a1da6 Jun 01 04:20:49.257730 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-User-Name: admin Jun 01 04:20:49.257730 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: method: > Jun 01 04:20:49.257730 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: exception: Flavor 42 could not be found. Jun 01 04:20:49.257730 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: action_args: {'id': '42'} Jun 01 04:20:49.257730 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:20:49.257730 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:20:49.258689 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 01 04:20:49.258689 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 01 04:20:49.258689 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 01 04:20:49.258689 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 01 04:20:49.258689 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 01 04:20:49.258689 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 01 04:20:49.258689 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 01 04:20:49.258689 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 01 04:20:49.258689 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 01 04:20:49.258689 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:20:49.258689 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 01 04:20:49.258689 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 01 04:20:49.258689 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 01 04:20:49.258689 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi Jun 01 04:20:49.258689 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:20:49.258689 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi Jun 01 04:20:49.258689 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:20:49.258689 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:20:49.258689 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:20:49.259962 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:20:49.259962 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:20:49.259962 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:20:49.259962 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:20:49.259962 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 01 04:20:49.259962 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:20:49.259962 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 01 04:20:49.259962 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi Jun 01 04:20:49.259962 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:20:49.259962 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi Jun 01 04:20:49.259962 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:20:49.259962 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:20:49.259962 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:20:49.259962 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:20:49.259962 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:20:49.259962 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 01 04:20:49.259962 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi Jun 01 04:20:49.259962 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-560e9a3d-ef01-41fa-826c-58f65b556cb8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:20:49.261262 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-560e9a3d-ef01-41fa-826c-58f65b556cb8 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014786 Jun 01 04:20:49.261262 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 22/42] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Jun 1 04:20:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 01 04:20:50.132281 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-a6256130-54eb-452c-bc2b-09382889c3b6 admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:50.133294 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-a6256130-54eb-452c-bc2b-09382889c3b6 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jun 01 04:20:50.133692 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 21/43] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 1 04:20:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:20:50.324747 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-e8272228-e2ed-4863-aa95-f2e5dc994b46 admin admin] Calling method '>' {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:50.330150 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.wsgi [None req-e8272228-e2ed-4863-aa95-f2e5dc994b46 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 01 04:20:50.331693 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-e8272228-e2ed-4863-aa95-f2e5dc994b46 admin admin] Request method failure captured: Jun 01 04:20:50.331693 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 01 04:20:50.331693 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: Accept: application/json Jun 01 04:20:50.331693 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: Accept-Encoding: gzip, deflate Jun 01 04:20:50.331693 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: Connection: keep-alive Jun 01 04:20:50.331693 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: Content-Length: 0 Jun 01 04:20:50.331693 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: Host: 10.222.0.18 Jun 01 04:20:50.331693 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: Openstack-Api-Version: compute 2.90 Jun 01 04:20:50.331693 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: Openstack-System-Scope: None Jun 01 04:20:50.331693 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: User-Agent: python-novaclient Jun 01 04:20:50.331693 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Auth-Token: gAAAAABiluki8O3O1Tz7IXIOoOvTaRxKhpeYIzIyLVkLDM6j3f8lOE5WXeQQF9gtg0BIQ6o40ApklUIsPOnf8ToeRjZMzErWzLEemADx8QyKmhiqicNVgi2GhBP0TACdKkMM0mqvWhVwlYxoSwI3z_02oyYMYpInBdc9-XQpl40If5qkwwoEiLU Jun 01 04:20:50.331693 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Domain-Id: None Jun 01 04:20:50.331693 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Domain-Name: None Jun 01 04:20:50.331693 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Identity-Status: Confirmed Jun 01 04:20:50.331693 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Is-Admin-Project: True Jun 01 04:20:50.331693 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Openstack-Nova-Api-Version: 2.90 Jun 01 04:20:50.331693 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Project-Domain-Id: default Jun 01 04:20:50.331693 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Project-Domain-Name: Default Jun 01 04:20:50.331693 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Project-Id: efd554ba71f4463abb4c78dc3cafe52a Jun 01 04:20:50.331693 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Project-Name: admin Jun 01 04:20:50.331693 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Role: reader,member,admin Jun 01 04:20:50.331693 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Roles: reader,member,admin Jun 01 04:20:50.333537 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/efd554ba71f4463abb4c78dc3cafe52a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_efd554ba71f4463abb4c78dc3cafe52a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/efd554ba71f4463abb4c78dc3cafe52a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/efd554ba71f4463abb4c78dc3cafe52a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:20:50.333537 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Tenant: admin Jun 01 04:20:50.333537 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Tenant-Id: efd554ba71f4463abb4c78dc3cafe52a Jun 01 04:20:50.333537 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Tenant-Name: admin Jun 01 04:20:50.333537 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-User: admin Jun 01 04:20:50.333537 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-User-Domain-Id: default Jun 01 04:20:50.333537 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-User-Domain-Name: Default Jun 01 04:20:50.333537 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-User-Id: c2efe34f830a400eb5eb8876be2a1da6 Jun 01 04:20:50.333537 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-User-Name: admin Jun 01 04:20:50.333537 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: method: > Jun 01 04:20:50.333537 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: exception: Flavor 84 could not be found. Jun 01 04:20:50.333537 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: action_args: {'id': '84'} Jun 01 04:20:50.333537 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:20:50.333537 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:20:50.334324 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 01 04:20:50.334324 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 01 04:20:50.334324 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 01 04:20:50.334324 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 01 04:20:50.334324 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 01 04:20:50.334324 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 01 04:20:50.334324 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 01 04:20:50.334324 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 01 04:20:50.334324 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 01 04:20:50.334324 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:20:50.334324 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 01 04:20:50.334324 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 01 04:20:50.334324 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 01 04:20:50.334324 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi Jun 01 04:20:50.334324 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:20:50.334324 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi Jun 01 04:20:50.334324 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:20:50.334324 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:20:50.334324 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:20:50.335468 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:20:50.335468 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:20:50.335468 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:20:50.335468 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:20:50.335468 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 01 04:20:50.335468 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:20:50.335468 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 01 04:20:50.335468 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi Jun 01 04:20:50.335468 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:20:50.335468 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi Jun 01 04:20:50.335468 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:20:50.335468 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:20:50.335468 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:20:50.335468 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:20:50.335468 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:20:50.335468 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 01 04:20:50.335468 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi Jun 01 04:20:50.335468 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-e8272228-e2ed-4863-aa95-f2e5dc994b46 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:20:50.336610 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-e8272228-e2ed-4863-aa95-f2e5dc994b46 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.062324 Jun 01 04:20:50.336610 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 23/44] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Jun 1 04:20:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 01 04:20:50.344020 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-6164c67d-dbba-489b-8760-7454073df7df admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:50.358124 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-6164c67d-dbba-489b-8760-7454073df7df admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017778 Jun 01 04:20:50.358667 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 22/45] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Jun 1 04:20:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:20:50.368529 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-83fb81af-3d82-419c-8750-a7206c4af832 admin admin] Calling method '>' {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:50.382648 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-83fb81af-3d82-419c-8750-a7206c4af832 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017957 Jun 01 04:20:50.383234 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Jun 1 04:20:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:20:50.392943 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-e7bd0cce-38db-443d-b335-d59d7d01b924 admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:50.398993 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.wsgi [None req-e7bd0cce-38db-443d-b335-d59d7d01b924 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 01 04:20:50.400550 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-e7bd0cce-38db-443d-b335-d59d7d01b924 admin admin] Request method failure captured: Jun 01 04:20:50.400550 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 01 04:20:50.400550 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: Accept: application/json Jun 01 04:20:50.400550 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: Accept-Encoding: gzip, deflate Jun 01 04:20:50.400550 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: Connection: keep-alive Jun 01 04:20:50.400550 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: Content-Length: 0 Jun 01 04:20:50.400550 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: Host: 10.222.0.18 Jun 01 04:20:50.400550 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: Openstack-Api-Version: compute 2.90 Jun 01 04:20:50.400550 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: Openstack-System-Scope: None Jun 01 04:20:50.400550 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: User-Agent: python-novaclient Jun 01 04:20:50.400550 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Auth-Token: gAAAAABiluki8O3O1Tz7IXIOoOvTaRxKhpeYIzIyLVkLDM6j3f8lOE5WXeQQF9gtg0BIQ6o40ApklUIsPOnf8ToeRjZMzErWzLEemADx8QyKmhiqicNVgi2GhBP0TACdKkMM0mqvWhVwlYxoSwI3z_02oyYMYpInBdc9-XQpl40If5qkwwoEiLU Jun 01 04:20:50.400550 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Domain-Id: None Jun 01 04:20:50.400550 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Domain-Name: None Jun 01 04:20:50.400550 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Identity-Status: Confirmed Jun 01 04:20:50.400550 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Is-Admin-Project: True Jun 01 04:20:50.400550 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Openstack-Nova-Api-Version: 2.90 Jun 01 04:20:50.400550 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Project-Domain-Id: default Jun 01 04:20:50.400550 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Project-Domain-Name: Default Jun 01 04:20:50.400550 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Project-Id: efd554ba71f4463abb4c78dc3cafe52a Jun 01 04:20:50.400550 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Project-Name: admin Jun 01 04:20:50.400550 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Role: reader,member,admin Jun 01 04:20:50.400550 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Roles: reader,member,admin Jun 01 04:20:50.401910 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/efd554ba71f4463abb4c78dc3cafe52a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_efd554ba71f4463abb4c78dc3cafe52a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/efd554ba71f4463abb4c78dc3cafe52a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/efd554ba71f4463abb4c78dc3cafe52a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:20:50.401910 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Tenant: admin Jun 01 04:20:50.401910 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Tenant-Id: efd554ba71f4463abb4c78dc3cafe52a Jun 01 04:20:50.401910 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Tenant-Name: admin Jun 01 04:20:50.401910 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-User: admin Jun 01 04:20:50.401910 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-User-Domain-Id: default Jun 01 04:20:50.401910 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-User-Domain-Name: Default Jun 01 04:20:50.401910 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-User-Id: c2efe34f830a400eb5eb8876be2a1da6 Jun 01 04:20:50.401910 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-User-Name: admin Jun 01 04:20:50.401910 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: method: > Jun 01 04:20:50.401910 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: exception: Flavor 84 could not be found. Jun 01 04:20:50.401910 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: action_args: {'id': '84'} Jun 01 04:20:50.401910 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:20:50.401910 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:20:50.402709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 01 04:20:50.402709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 01 04:20:50.402709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 01 04:20:50.402709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 01 04:20:50.402709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 01 04:20:50.402709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 01 04:20:50.402709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 01 04:20:50.402709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 01 04:20:50.402709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 01 04:20:50.402709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:20:50.402709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 01 04:20:50.402709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 01 04:20:50.402709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 01 04:20:50.402709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Jun 01 04:20:50.402709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:20:50.402709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Jun 01 04:20:50.402709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:20:50.402709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:20:50.402709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:20:50.403876 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:20:50.403876 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:20:50.403876 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:20:50.403876 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:20:50.403876 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 01 04:20:50.403876 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:20:50.403876 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 01 04:20:50.403876 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Jun 01 04:20:50.403876 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:20:50.403876 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Jun 01 04:20:50.403876 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:20:50.403876 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:20:50.403876 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:20:50.403876 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:20:50.403876 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:20:50.403876 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 01 04:20:50.403876 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Jun 01 04:20:50.403876 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-e7bd0cce-38db-443d-b335-d59d7d01b924 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:20:50.405073 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-e7bd0cce-38db-443d-b335-d59d7d01b924 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012720 Jun 01 04:20:50.405073 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 23/47] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Jun 1 04:20:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 01 04:20:51.268755 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-83fb81af-3d82-419c-8750-a7206c4af832 admin admin] Calling method '>' {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:51.269768 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-83fb81af-3d82-419c-8750-a7206c4af832 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jun 01 04:20:51.270194 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 25/48] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 1 04:20:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:20:51.462587 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-004e1c10-1fed-4975-ab30-ce8670afac73 admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:51.468435 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.wsgi [None req-004e1c10-1fed-4975-ab30-ce8670afac73 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 01 04:20:51.478709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-004e1c10-1fed-4975-ab30-ce8670afac73 admin admin] Request method failure captured: Jun 01 04:20:51.478709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 01 04:20:51.478709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: Accept: application/json Jun 01 04:20:51.478709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: Accept-Encoding: gzip, deflate Jun 01 04:20:51.478709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: Connection: keep-alive Jun 01 04:20:51.478709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: Content-Length: 0 Jun 01 04:20:51.478709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: Host: 10.222.0.18 Jun 01 04:20:51.478709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: Openstack-Api-Version: compute 2.90 Jun 01 04:20:51.478709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: Openstack-System-Scope: None Jun 01 04:20:51.478709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: User-Agent: python-novaclient Jun 01 04:20:51.478709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Auth-Token: gAAAAABilukjTNAM3TKXOPses7bcXKzXKeJur2opDOP4gzHx5xXolkuW4fUobnkKnjRcLq1K502oFSum_bRnxwtptyabc7lwlEBJ3Fu6pF6ztC3GIWhp5GfWvdaSSSyjUqpOgc2R3Y4obI27MO97AhXcHIJlGeYm3Z4d-H9PDPeVHVdwDoCS5a8 Jun 01 04:20:51.478709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Domain-Id: None Jun 01 04:20:51.478709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Domain-Name: None Jun 01 04:20:51.478709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Identity-Status: Confirmed Jun 01 04:20:51.478709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Is-Admin-Project: True Jun 01 04:20:51.478709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Openstack-Nova-Api-Version: 2.90 Jun 01 04:20:51.478709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Project-Domain-Id: default Jun 01 04:20:51.478709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Project-Domain-Name: Default Jun 01 04:20:51.478709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Project-Id: efd554ba71f4463abb4c78dc3cafe52a Jun 01 04:20:51.478709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Project-Name: admin Jun 01 04:20:51.478709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Role: reader,member,admin Jun 01 04:20:51.478709 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Roles: reader,member,admin Jun 01 04:20:51.481004 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/efd554ba71f4463abb4c78dc3cafe52a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_efd554ba71f4463abb4c78dc3cafe52a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/efd554ba71f4463abb4c78dc3cafe52a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/efd554ba71f4463abb4c78dc3cafe52a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:20:51.481004 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Tenant: admin Jun 01 04:20:51.481004 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Tenant-Id: efd554ba71f4463abb4c78dc3cafe52a Jun 01 04:20:51.481004 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-Tenant-Name: admin Jun 01 04:20:51.481004 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-User: admin Jun 01 04:20:51.481004 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-User-Domain-Id: default Jun 01 04:20:51.481004 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-User-Domain-Name: Default Jun 01 04:20:51.481004 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-User-Id: c2efe34f830a400eb5eb8876be2a1da6 Jun 01 04:20:51.481004 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: X-User-Name: admin Jun 01 04:20:51.481004 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: method: > Jun 01 04:20:51.481004 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: exception: Flavor 451 could not be found. Jun 01 04:20:51.481004 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: action_args: {'id': '451'} Jun 01 04:20:51.481004 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:20:51.481004 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:20:51.482154 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 01 04:20:51.482154 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 01 04:20:51.482154 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 01 04:20:51.482154 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 01 04:20:51.482154 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 01 04:20:51.482154 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 01 04:20:51.482154 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 01 04:20:51.482154 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 01 04:20:51.482154 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 01 04:20:51.482154 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:20:51.482154 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 01 04:20:51.482154 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 01 04:20:51.482154 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 01 04:20:51.482154 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Jun 01 04:20:51.482154 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:20:51.482154 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Jun 01 04:20:51.482154 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:20:51.482154 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:20:51.482154 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:20:51.483228 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:20:51.483228 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:20:51.483228 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:20:51.483228 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:20:51.483228 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 01 04:20:51.483228 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:20:51.483228 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 01 04:20:51.483228 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Jun 01 04:20:51.483228 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:20:51.483228 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Jun 01 04:20:51.483228 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:20:51.483228 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:20:51.483228 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:20:51.483228 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:20:51.483228 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:20:51.483228 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 01 04:20:51.483228 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Jun 01 04:20:51.483228 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-004e1c10-1fed-4975-ab30-ce8670afac73 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:20:51.484285 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-004e1c10-1fed-4975-ab30-ce8670afac73 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062496 Jun 01 04:20:51.484285 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 24/49] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Jun 1 04:20:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 01 04:20:51.484844 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-7c9a5544-251b-4e1b-87f2-269f7f94c9fe admin admin] Calling method '>' {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:51.499456 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-7c9a5544-251b-4e1b-87f2-269f7f94c9fe admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018169 Jun 01 04:20:51.499992 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 26/50] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Jun 1 04:20:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:20:51.509513 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-abaf394b-a75c-4b0c-8278-2f5d283df5fe admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:51.522948 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-abaf394b-a75c-4b0c-8278-2f5d283df5fe admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016958 Jun 01 04:20:51.523512 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 25/51] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Jun 1 04:20:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:20:51.534767 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-24a3bd10-63c6-491e-a5c9-e38c4e97d4ae admin admin] Calling method '>' {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:51.540822 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.wsgi [None req-24a3bd10-63c6-491e-a5c9-e38c4e97d4ae admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 01 04:20:51.542512 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-24a3bd10-63c6-491e-a5c9-e38c4e97d4ae admin admin] Request method failure captured: Jun 01 04:20:51.542512 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 01 04:20:51.542512 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: Accept: application/json Jun 01 04:20:51.542512 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: Accept-Encoding: gzip, deflate Jun 01 04:20:51.542512 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: Connection: keep-alive Jun 01 04:20:51.542512 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: Content-Length: 0 Jun 01 04:20:51.542512 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: Host: 10.222.0.18 Jun 01 04:20:51.542512 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: Openstack-Api-Version: compute 2.90 Jun 01 04:20:51.542512 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: Openstack-System-Scope: None Jun 01 04:20:51.542512 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: User-Agent: python-novaclient Jun 01 04:20:51.542512 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Auth-Token: gAAAAABilukjTNAM3TKXOPses7bcXKzXKeJur2opDOP4gzHx5xXolkuW4fUobnkKnjRcLq1K502oFSum_bRnxwtptyabc7lwlEBJ3Fu6pF6ztC3GIWhp5GfWvdaSSSyjUqpOgc2R3Y4obI27MO97AhXcHIJlGeYm3Z4d-H9PDPeVHVdwDoCS5a8 Jun 01 04:20:51.542512 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Domain-Id: None Jun 01 04:20:51.542512 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Domain-Name: None Jun 01 04:20:51.542512 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Identity-Status: Confirmed Jun 01 04:20:51.542512 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Is-Admin-Project: True Jun 01 04:20:51.542512 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Openstack-Nova-Api-Version: 2.90 Jun 01 04:20:51.542512 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Project-Domain-Id: default Jun 01 04:20:51.542512 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Project-Domain-Name: Default Jun 01 04:20:51.542512 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Project-Id: efd554ba71f4463abb4c78dc3cafe52a Jun 01 04:20:51.542512 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Project-Name: admin Jun 01 04:20:51.542512 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Role: reader,member,admin Jun 01 04:20:51.542512 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Roles: reader,member,admin Jun 01 04:20:51.543939 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/efd554ba71f4463abb4c78dc3cafe52a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_efd554ba71f4463abb4c78dc3cafe52a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/efd554ba71f4463abb4c78dc3cafe52a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/efd554ba71f4463abb4c78dc3cafe52a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:20:51.543939 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Tenant: admin Jun 01 04:20:51.543939 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Tenant-Id: efd554ba71f4463abb4c78dc3cafe52a Jun 01 04:20:51.543939 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-Tenant-Name: admin Jun 01 04:20:51.543939 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-User: admin Jun 01 04:20:51.543939 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-User-Domain-Id: default Jun 01 04:20:51.543939 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-User-Domain-Name: Default Jun 01 04:20:51.543939 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-User-Id: c2efe34f830a400eb5eb8876be2a1da6 Jun 01 04:20:51.543939 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: X-User-Name: admin Jun 01 04:20:51.543939 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: method: > Jun 01 04:20:51.543939 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: exception: Flavor 451 could not be found. Jun 01 04:20:51.543939 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: action_args: {'id': '451'} Jun 01 04:20:51.543939 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:20:51.543939 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:20:51.544819 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 01 04:20:51.544819 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 01 04:20:51.544819 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 01 04:20:51.544819 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 01 04:20:51.544819 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 01 04:20:51.544819 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 01 04:20:51.544819 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 01 04:20:51.544819 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 01 04:20:51.544819 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 01 04:20:51.544819 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:20:51.544819 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 01 04:20:51.544819 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 01 04:20:51.544819 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 01 04:20:51.544819 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi Jun 01 04:20:51.544819 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:20:51.544819 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi Jun 01 04:20:51.544819 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:20:51.544819 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:20:51.544819 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:20:51.545895 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:20:51.545895 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:20:51.545895 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:20:51.545895 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:20:51.545895 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 01 04:20:51.545895 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:20:51.545895 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 01 04:20:51.545895 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi Jun 01 04:20:51.545895 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:20:51.545895 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi Jun 01 04:20:51.545895 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:20:51.545895 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:20:51.545895 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:20:51.545895 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:20:51.545895 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:20:51.545895 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 01 04:20:51.545895 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: ERROR nova.api.openstack.wsgi Jun 01 04:20:51.545895 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-24a3bd10-63c6-491e-a5c9-e38c4e97d4ae admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:20:51.547005 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-24a3bd10-63c6-491e-a5c9-e38c4e97d4ae admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012741 Jun 01 04:20:51.547005 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 27/52] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Jun 1 04:20:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 01 04:20:52.421124 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-abaf394b-a75c-4b0c-8278-2f5d283df5fe admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:52.422148 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-abaf394b-a75c-4b0c-8278-2f5d283df5fe admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jun 01 04:20:52.422541 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 1 04:20:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:20:52.609990 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-eaa30fea-6e30-4d0c-8f9e-f0c35681afe0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:20:52.803959 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-eaa30fea-6e30-4d0c-8f9e-f0c35681afe0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.245420 Jun 01 04:20:52.804518 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 28/54] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Jun 1 04:20:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 01 04:20:53.678926 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-abaf394b-a75c-4b0c-8278-2f5d283df5fe admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:53.679960 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-abaf394b-a75c-4b0c-8278-2f5d283df5fe admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 01 04:20:53.680358 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 1 04:20:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:20:53.873046 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-b310d9bc-9f50-4afa-9335-70a6656cfbbe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:20:53.975335 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-b310d9bc-9f50-4afa-9335-70a6656cfbbe admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.156977 Jun 01 04:20:53.975812 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 29/56] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Jun 1 04:20:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 01 04:20:54.841113 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-abaf394b-a75c-4b0c-8278-2f5d283df5fe admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:54.842117 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-abaf394b-a75c-4b0c-8278-2f5d283df5fe admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jun 01 04:20:54.842513 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 28/57] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 1 04:20:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:20:55.031543 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-97a4be2b-0d98-4690-bc30-d94fe7981391 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:20:55.104754 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-97a4be2b-0d98-4690-bc30-d94fe7981391 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.126103 Jun 01 04:20:55.105257 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 30/58] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Jun 1 04:20:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 01 04:20:55.990369 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-abaf394b-a75c-4b0c-8278-2f5d283df5fe admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:55.991398 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-abaf394b-a75c-4b0c-8278-2f5d283df5fe admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jun 01 04:20:55.991799 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 29/59] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 1 04:20:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:20:56.179675 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-30c9285d-22ac-46b3-b26c-3017d05b2a01 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:20:56.256259 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-30c9285d-22ac-46b3-b26c-3017d05b2a01 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.128205 Jun 01 04:20:56.256721 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 31/60] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Jun 1 04:20:56 2022] POST /compute/v2.1/flavors => generated 409 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 01 04:20:57.127372 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-abaf394b-a75c-4b0c-8278-2f5d283df5fe admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:57.128383 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-abaf394b-a75c-4b0c-8278-2f5d283df5fe admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jun 01 04:20:57.129355 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 30/61] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 1 04:20:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:20:57.318353 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-545bf117-211f-49dd-a490-b079e4656eb2 admin admin] Calling method '>' {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:20:57.337646 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-545bf117-211f-49dd-a490-b079e4656eb2 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072045 Jun 01 04:20:57.338205 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 32/62] 10.222.0.18 () {60 vars in 1202 bytes} [Wed Jun 1 04:20:57 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:21:59.018550 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-abaf394b-a75c-4b0c-8278-2f5d283df5fe admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:21:59.019626 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-abaf394b-a75c-4b0c-8278-2f5d283df5fe admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002018 Jun 01 04:21:59.020234 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 31/63] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jun 1 04:21:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:21:59.027522 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG dbcounter [-] [103909] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:21:59.080419 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-77660787-bb5c-4390-a524-1e905da3d2db admin admin] Calling method '>' {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:21:59.100043 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-77660787-bb5c-4390-a524-1e905da3d2db admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073876 Jun 01 04:21:59.100589 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 33/64] 10.222.0.18 () {60 vars in 1291 bytes} [Wed Jun 1 04:21:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:21:59.122622 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG dbcounter [-] [103908] Writing DB stats nova_api:SELECT=14 {{(pid=103908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:21:59.126291 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-c8bdf13c-3ded-4259-91d7-6c02c690f1d8 admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:21:59.133994 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-c8bdf13c-3ded-4259-91d7-6c02c690f1d8 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012785 Jun 01 04:21:59.135187 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 32/65] 10.222.0.18 () {60 vars in 1282 bytes} [Wed Jun 1 04:21:59 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:21:59.146158 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-6cce82d9-4111-4ebd-a8d2-77c834346cea admin admin] Calling method '>' {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:21:59.153960 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-6cce82d9-4111-4ebd-a8d2-77c834346cea admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011360 Jun 01 04:21:59.154600 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 34/66] 10.222.0.18 () {60 vars in 1285 bytes} [Wed Jun 1 04:21:59 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:21:59.166847 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-799a0a99-01a9-4f8f-94a8-e908458ec9c0 admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:21:59.174992 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-799a0a99-01a9-4f8f-94a8-e908458ec9c0 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012071 Jun 01 04:21:59.175542 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 33/67] 10.222.0.18 () {60 vars in 1285 bytes} [Wed Jun 1 04:21:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:21:59.186826 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-6b55b3fc-2c35-43bc-97ca-500f17d77a61 admin admin] Calling method '>' {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:21:59.194460 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-6b55b3fc-2c35-43bc-97ca-500f17d77a61 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011116 Jun 01 04:21:59.194977 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 35/68] 10.222.0.18 () {60 vars in 1282 bytes} [Wed Jun 1 04:21:59 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:25:24.035968 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-799a0a99-01a9-4f8f-94a8-e908458ec9c0 admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:25:24.037015 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-799a0a99-01a9-4f8f-94a8-e908458ec9c0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jun 01 04:25:24.037439 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 34/69] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 1 04:25:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:25:24.193812 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG dbcounter [-] [103909] Writing DB stats nova_api:SELECT=6 {{(pid=103909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:25:24.311286 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-6ef8ff51-98e0-4944-b623-d12a92642892 admin admin] Calling method '>' {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:25:24.312465 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 01 04:25:24.312465 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: warnings.warn(msg) Jun 01 04:25:24.313647 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG oslo_concurrency.lockutils [None req-6ef8ff51-98e0-4944-b623-d12a92642892 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:25:24.314081 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG oslo_concurrency.lockutils [None req-6ef8ff51-98e0-4944-b623-d12a92642892 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:25:24.314850 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG oslo_concurrency.lockutils [None req-6ef8ff51-98e0-4944-b623-d12a92642892 admin admin] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:25:24.315270 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG oslo_concurrency.lockutils [None req-6ef8ff51-98e0-4944-b623-d12a92642892 admin admin] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:25:24.348756 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-6ef8ff51-98e0-4944-b623-d12a92642892 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.156380 Jun 01 04:25:24.349314 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 36/70] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Jun 1 04:25:24 2022] GET /compute/v2.1/os-services => generated 794 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 01 04:25:25.216523 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-799a0a99-01a9-4f8f-94a8-e908458ec9c0 admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:25:25.217533 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-799a0a99-01a9-4f8f-94a8-e908458ec9c0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jun 01 04:25:25.217931 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 35/71] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 1 04:25:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:25:25.408437 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-33d58b75-96b3-4dc4-926f-a81910deb09f admin admin] Calling method '>' {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:25:25.409610 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 01 04:25:25.409610 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: warnings.warn(msg) Jun 01 04:25:25.410791 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG oslo_concurrency.lockutils [None req-33d58b75-96b3-4dc4-926f-a81910deb09f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:25:25.411230 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG oslo_concurrency.lockutils [None req-33d58b75-96b3-4dc4-926f-a81910deb09f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:25:25.412180 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG oslo_concurrency.lockutils [None req-33d58b75-96b3-4dc4-926f-a81910deb09f admin admin] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:25:25.412610 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG oslo_concurrency.lockutils [None req-33d58b75-96b3-4dc4-926f-a81910deb09f admin admin] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:25:25.433553 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-33d58b75-96b3-4dc4-926f-a81910deb09f admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.076391 Jun 01 04:25:25.434093 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 37/72] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Jun 1 04:25:25 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 01 04:25:36.736715 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-799a0a99-01a9-4f8f-94a8-e908458ec9c0 admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:25:36.737722 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-799a0a99-01a9-4f8f-94a8-e908458ec9c0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jun 01 04:25:36.738123 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 36/73] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 1 04:25:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:25:36.881708 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG dbcounter [-] [103909] Writing DB stats nova_cell0:SELECT=4 {{(pid=103909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:25:36.882372 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG dbcounter [-] [103909] Writing DB stats nova_cell1:SELECT=4 {{(pid=103909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:25:36.882984 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG dbcounter [-] [103909] Writing DB stats nova_api:SELECT=8 {{(pid=103909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:25:36.931586 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-4195f372-0078-4c11-995a-72356ac9bdd0 admin admin] Calling method '>' {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:25:36.932788 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 01 04:25:36.932788 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: warnings.warn(msg) Jun 01 04:25:36.933999 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG oslo_concurrency.lockutils [None req-4195f372-0078-4c11-995a-72356ac9bdd0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:25:36.934434 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG oslo_concurrency.lockutils [None req-4195f372-0078-4c11-995a-72356ac9bdd0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:25:36.935214 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG oslo_concurrency.lockutils [None req-4195f372-0078-4c11-995a-72356ac9bdd0 admin admin] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:25:36.935692 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG oslo_concurrency.lockutils [None req-4195f372-0078-4c11-995a-72356ac9bdd0 admin admin] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:25:36.960711 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-4195f372-0078-4c11-995a-72356ac9bdd0 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.083566 Jun 01 04:25:36.961777 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 38/74] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Jun 1 04:25:36 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:25:37.836763 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-799a0a99-01a9-4f8f-94a8-e908458ec9c0 admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:25:37.837764 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-799a0a99-01a9-4f8f-94a8-e908458ec9c0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001935 Jun 01 04:25:37.838162 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 37/75] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jun 1 04:25:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:25:38.026503 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG nova.api.openstack.wsgi [None req-1bbbeff6-c222-4292-9f33-a55e9511a9b4 admin admin] Calling method '>' {{(pid=103909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:25:38.027774 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 01 04:25:38.027774 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: warnings.warn(msg) Jun 01 04:25:38.028994 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG oslo_concurrency.lockutils [None req-1bbbeff6-c222-4292-9f33-a55e9511a9b4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:25:38.029466 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG oslo_concurrency.lockutils [None req-1bbbeff6-c222-4292-9f33-a55e9511a9b4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:25:38.030255 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG oslo_concurrency.lockutils [None req-1bbbeff6-c222-4292-9f33-a55e9511a9b4 admin admin] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:25:38.030709 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: DEBUG oslo_concurrency.lockutils [None req-1bbbeff6-c222-4292-9f33-a55e9511a9b4 admin admin] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:25:38.052103 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: INFO nova.api.openstack.requestlog [None req-1bbbeff6-c222-4292-9f33-a55e9511a9b4 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.078020 Jun 01 04:25:38.052678 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: [pid: 103909|app: 0|req: 39/76] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Jun 1 04:25:37 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:26:36.984153 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: Wed Jun 1 04:26:36 2022 - graceful shutdown triggered... Jun 01 04:26:36.984707 dv-cinder-667108-37-iscsi devstack@n-api.service[103908]: Gracefully killing worker 1 (pid: 103908)... Jun 01 04:26:36.985136 dv-cinder-667108-37-iscsi devstack@n-api.service[103909]: Gracefully killing worker 2 (pid: 103909)... Jun 01 04:26:36.986322 dv-cinder-667108-37-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 01 04:26:37.985359 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: worker 1 buried after 1 seconds Jun 01 04:26:37.985359 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: worker 2 buried after 1 seconds Jun 01 04:26:37.985359 dv-cinder-667108-37-iscsi devstack@n-api.service[103907]: goodbye to uWSGI. Jun 01 04:26:37.986912 dv-cinder-667108-37-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 01 04:26:37.987493 dv-cinder-667108-37-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 01 04:26:37.990205 dv-cinder-667108-37-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 01 04:26:38.006989 dv-cinder-667108-37-iscsi devstack@n-api.service[118503]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 01 04:26:38.018149 dv-cinder-667108-37-iscsi devstack@n-api.service[118503]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 1 04:26:38 2022] *** Jun 01 04:26:38.018149 dv-cinder-667108-37-iscsi devstack@n-api.service[118503]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 01 04:26:38.018149 dv-cinder-667108-37-iscsi devstack@n-api.service[118503]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 01 04:26:38.018149 dv-cinder-667108-37-iscsi devstack@n-api.service[118503]: nodename: dv-cinder-667108-37-iscsi Jun 01 04:26:38.018149 dv-cinder-667108-37-iscsi devstack@n-api.service[118503]: machine: x86_64 Jun 01 04:26:38.018149 dv-cinder-667108-37-iscsi devstack@n-api.service[118503]: clock source: unix Jun 01 04:26:38.018149 dv-cinder-667108-37-iscsi devstack@n-api.service[118503]: pcre jit disabled Jun 01 04:26:38.018149 dv-cinder-667108-37-iscsi devstack@n-api.service[118503]: detected number of CPU cores: 4 Jun 01 04:26:38.018149 dv-cinder-667108-37-iscsi devstack@n-api.service[118503]: current working directory: / Jun 01 04:26:38.018149 dv-cinder-667108-37-iscsi devstack@n-api.service[118503]: detected binary path: /usr/bin/uwsgi-core Jun 01 04:26:38.018149 dv-cinder-667108-37-iscsi devstack@n-api.service[118503]: your processes number limit is 47680 Jun 01 04:26:38.018149 dv-cinder-667108-37-iscsi devstack@n-api.service[118503]: your memory page size is 4096 bytes Jun 01 04:26:38.019079 dv-cinder-667108-37-iscsi devstack@n-api.service[118503]: detected max file descriptor number: 2048 Jun 01 04:26:38.019079 dv-cinder-667108-37-iscsi devstack@n-api.service[118503]: lock engine: pthread robust mutexes Jun 01 04:26:38.019079 dv-cinder-667108-37-iscsi devstack@n-api.service[118503]: thunder lock: enabled Jun 01 04:26:38.019079 dv-cinder-667108-37-iscsi devstack@n-api.service[118503]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 01 04:26:38.019079 dv-cinder-667108-37-iscsi devstack@n-api.service[118503]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 01 04:26:38.064854 dv-cinder-667108-37-iscsi devstack@n-api.service[118503]: Python main interpreter initialized at 0x55c15146c9c0 Jun 01 04:26:38.064854 dv-cinder-667108-37-iscsi devstack@n-api.service[118503]: python threads support enabled Jun 01 04:26:38.064854 dv-cinder-667108-37-iscsi devstack@n-api.service[118503]: your server socket listen backlog is limited to 100 connections Jun 01 04:26:38.064854 dv-cinder-667108-37-iscsi devstack@n-api.service[118503]: your mercy for graceful operations on workers is 90 seconds Jun 01 04:26:38.065299 dv-cinder-667108-37-iscsi devstack@n-api.service[118503]: mapped 403077 bytes (393 KB) for 2 cores Jun 01 04:26:38.065299 dv-cinder-667108-37-iscsi devstack@n-api.service[118503]: *** Operational MODE: preforking *** Jun 01 04:26:38.065556 dv-cinder-667108-37-iscsi devstack@n-api.service[118503]: *** uWSGI is running in multiple interpreter mode *** Jun 01 04:26:38.065556 dv-cinder-667108-37-iscsi devstack@n-api.service[118503]: spawned uWSGI master process (pid: 118503) Jun 01 04:26:38.065763 dv-cinder-667108-37-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 01 04:26:38.067881 dv-cinder-667108-37-iscsi devstack@n-api.service[118503]: spawned uWSGI worker 1 (pid: 118516, cores: 1) Jun 01 04:26:38.067881 dv-cinder-667108-37-iscsi devstack@n-api.service[118503]: spawned uWSGI worker 2 (pid: 118517, cores: 1) Jun 01 04:26:38.067881 dv-cinder-667108-37-iscsi devstack@n-api.service[118503]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 01 04:26:39.304776 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 01 04:26:39.311037 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 01 04:26:40.144985 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 01 04:26:40.144985 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: from cryptography.utils import int_from_bytes Jun 01 04:26:40.145318 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 01 04:26:40.145318 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: from cryptography.utils import int_from_bytes Jun 01 04:26:40.154512 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 01 04:26:40.154512 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: from cryptography.utils import int_from_bytes Jun 01 04:26:40.154863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 01 04:26:40.154863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: from cryptography.utils import int_from_bytes Jun 01 04:26:42.565509 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 01 04:26:42.566139 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 01 04:26:42.566290 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 01 04:26:42.566460 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 01 04:26:42.566844 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 01 04:26:42.566935 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 01 04:26:42.566935 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 01 04:26:42.567085 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 01 04:26:42.567331 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.567463 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 01 04:26:42.567618 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.567746 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 01 04:26:42.567943 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.568055 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.568261 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.568371 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.568595 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.568716 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.568914 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.569046 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.569230 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.569332 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.569548 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.569650 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.569875 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.569980 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.570139 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.570238 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.570457 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.570559 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.570784 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-667108-37-iscsi {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.570898 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.571105 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.571527 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.571527 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-667108-37-iscsi {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.571724 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.571815 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.571913 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.572100 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.572193 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.572405 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.572500 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.572730 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.572870 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.573035 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.573142 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.573358 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.573530 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.573658 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.574715 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.574834 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.574936 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.575012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.575097 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.575895 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.576029 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.576121 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.576206 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.576206 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.576352 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.576427 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.576504 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.576705 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.576803 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.577018 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.577189 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.577325 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.577422 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.577661 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.577774 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-667108-37-iscsi {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.577979 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.578089 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.578339 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.578447 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-667108-37-iscsi {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.578660 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.578768 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.579002 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.579111 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.579348 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.579471 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.579701 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.579811 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.580030 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.580172 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.580354 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.580494 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.580663 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.580821 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.581322 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.581481 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.581481 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.581749 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.581895 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.582038 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.582038 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.582295 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.582436 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.582573 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.582721 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.582852 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.582988 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.583125 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.583264 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.583434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.583584 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.583721 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.583852 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.583988 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.584125 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.584270 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.584411 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.584551 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.584690 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.584827 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.584948 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.585082 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.585219 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.585362 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.585493 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.585633 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.585779 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.585920 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.586063 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.586201 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.586346 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.586490 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.586708 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.586842 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.586961 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.587104 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.587339 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.587489 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.587643 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.587919 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.588065 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.588204 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.588341 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.588586 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.588727 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.588871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.589017 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.589286 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.589430 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.589577 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.589709 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.589847 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.589986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.590128 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.590272 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.590399 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.590537 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.590668 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.590804 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.590944 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.591087 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.591226 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.591388 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.591528 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.591666 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.591797 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.591937 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.592078 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.592214 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.592370 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.592505 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.592697 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.592916 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.593056 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.593194 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.593326 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.593464 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.593610 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.593755 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.593929 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.594064 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.594241 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.594381 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.594556 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.594704 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.594835 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.594969 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.595114 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.595397 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.595553 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.595692 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.595833 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.595988 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.596208 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.596362 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.596507 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.596645 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.596861 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.597005 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.597147 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.597306 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.597480 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.597619 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.597756 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.598030 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.598172 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.598320 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.598453 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.598606 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.598825 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.598960 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.599107 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.599469 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.599609 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.599754 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.599893 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.600032 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.600162 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.600311 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.600443 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.600579 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.600709 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.600863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.601062 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.601217 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.601360 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.601489 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.601618 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.601747 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.601890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.602031 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.602173 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.602312 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.602444 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.602580 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.602719 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.602858 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.602988 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.603125 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.603265 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.603424 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.603565 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.603696 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.603826 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.603826 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.604063 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.604063 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.604223 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.604327 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.604414 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.604620 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.604716 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.604936 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.605040 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.605251 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.605367 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.605579 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.605687 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.605885 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.605994 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.606189 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.606289 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.606519 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.606619 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.606904 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.607019 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.607135 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.607235 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.607465 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.607574 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.607772 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.607874 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.608099 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.608204 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.608379 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.608472 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.608951 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.609072 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.609260 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.609377 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.609610 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.609722 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.609861 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.609960 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.610185 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.610279 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.610498 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.610605 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.610813 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.610917 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.611124 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.611226 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.611501 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:26:42.611647 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.612087 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.612282 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.612483 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.612705 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.612705 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.612952 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.613335 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.613549 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.613767 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.613935 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.614157 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.614296 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.614392 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.614478 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.614563 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.614653 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.614756 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.614850 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.614936 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.615027 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.615121 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.615214 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.615349 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.615455 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.615550 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.615668 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.615858 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.615962 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.616176 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.616273 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.616488 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.616582 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.616808 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.616911 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.617138 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.617254 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.617456 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.617558 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.617770 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.617865 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.618429 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.618667 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.618667 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.618823 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.619084 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.619194 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.619281 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.619400 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.619400 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.619787 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.619890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.619973 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.620060 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.620144 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.620320 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.620455 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.620717 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.620803 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.621046 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.621137 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.621359 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.621449 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.621676 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.621769 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.621986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.622626 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.622894 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.622983 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.623210 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.623334 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.624022 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.624133 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.624211 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.624292 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.624292 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.624445 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.624520 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.624600 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.624798 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.624883 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.625093 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.625396 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.625491 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.625750 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.625959 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.626078 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.626287 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.626400 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.626612 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.626727 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.626933 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.627028 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.627250 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.627422 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.627588 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.627680 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.627899 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.628001 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.628218 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.628310 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.628552 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.628648 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.628998 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.629114 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.629204 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.629289 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.629500 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.629613 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.629975 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.630100 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.630100 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.630261 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.630411 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.630514 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.630729 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.630832 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.631043 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.631137 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.631374 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.631473 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.631693 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.631795 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.632007 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.632109 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.632313 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.632404 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.632628 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.632722 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.632940 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.633044 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.633715 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.635345 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.635345 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.636728 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.636865 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.636994 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.636994 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.637196 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.637592 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.637791 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.638445 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.638810 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.638975 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.639115 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.639233 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.639403 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.639544 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.639645 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.639733 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.639831 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.640190 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.640293 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.640380 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.640454 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.640535 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.640624 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.640707 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.640780 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.640859 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.640955 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.641050 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.641145 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.641232 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.641317 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.641401 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.641485 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.641583 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.641670 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.641766 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.641852 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.641937 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.642031 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.642128 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.642222 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.642316 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.642402 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.642494 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.642587 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.642688 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.642775 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.642867 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.642961 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.643047 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.643132 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.643231 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.643350 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.643456 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.643544 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.643644 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.643745 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.643842 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.643937 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.644025 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.644121 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.644208 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.644307 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.644404 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.644497 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.644584 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.644669 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.644762 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.644862 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.644957 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.645044 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.645141 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.645346 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.645463 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.645698 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.645807 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.646046 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.646140 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.646365 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.646470 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.646678 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.646818 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.646994 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.647094 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.647344 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.647474 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.647719 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.647811 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.647952 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.648055 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.648265 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.648441 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.648582 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.648682 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.648915 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.649017 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.649217 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.649325 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.649521 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.649642 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.649842 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.649946 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.650152 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.650259 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.650479 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.650598 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.650804 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.650899 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.651117 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.651215 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.651473 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.651621 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.651799 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.651946 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.652100 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.652244 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.652415 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.652567 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.652710 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.652864 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.653015 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.653159 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.653346 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.653503 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.653650 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.653795 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.653953 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.654104 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.654268 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.654412 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.654586 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.654738 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.654888 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.655038 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.655207 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.655378 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.655543 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.655699 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.655849 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.656000 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.656143 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.656283 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.656457 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.656612 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.656787 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.656883 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.657120 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.657216 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.657430 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.657544 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.657750 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.657898 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.658074 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.658228 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.658374 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.658519 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.658683 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.658828 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.659089 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.659237 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.659434 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.659570 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.659703 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.659836 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.659976 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.660108 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.660350 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.660561 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.660695 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.660818 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.660949 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.661079 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.661322 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.661459 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.661591 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.661729 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.661871 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.662012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.662145 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.662275 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.662407 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.662538 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.662669 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.662809 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.662951 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.663083 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.663197 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.663345 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.663514 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.663665 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.663839 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.663975 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.664146 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.664276 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.664452 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.664599 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.664775 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.665022 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.665171 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.665287 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.665428 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.665658 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.665782 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.665963 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.666108 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.666304 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.666453 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.666661 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.666796 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.666926 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.667055 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.667198 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.667369 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.667562 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.667691 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.667984 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.668140 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.668276 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.668403 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.668535 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.668676 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.668799 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.669567 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.669708 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.669855 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.669996 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.670136 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.670270 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.670480 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.670712 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.670856 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.670989 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.671120 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.671262 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.671525 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.671673 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.671798 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.671938 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.672071 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.672202 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.672334 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.672476 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.672608 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.672740 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.672880 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.673012 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.673143 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.673283 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.673417 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.673566 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.673751 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.673932 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.674107 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.674254 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.674444 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.674588 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.674761 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.674897 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.675080 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.675428 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.675567 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.675749 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.675900 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.676079 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.676230 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.676401 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.676538 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.676728 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.676866 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.677018 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.677159 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.677331 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.677468 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.677639 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.677777 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.678072 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.678227 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.678369 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.678601 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.678821 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.678966 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.679107 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.679258 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.679454 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.679726 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.679866 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.680006 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.680139 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.680285 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.680425 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.680644 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.680863 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.680999 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.681140 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.681284 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.681434 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.681567 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.681698 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.681846 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.682074 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.682211 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.682351 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.682492 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.682626 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.682758 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.682901 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.683034 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.683166 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.683319 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.683467 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.683601 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.683748 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.683892 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.684026 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.684158 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.684286 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.684418 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.684599 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.685229 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.685364 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.685505 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.685647 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.685859 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.685996 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.686128 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.686396 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.686536 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.686677 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.686838 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.686981 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.687115 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.687247 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.687462 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.687605 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.687753 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.687895 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.688036 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.688320 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.688453 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.688593 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.688743 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.688876 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.689008 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.689141 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.689273 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.689420 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.689562 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.689824 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.689962 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.690094 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.690237 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.690380 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.690522 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.690677 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.690889 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.691090 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.691235 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.691402 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.691539 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.691671 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.691803 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.691950 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.692098 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.692330 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.692468 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.692616 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.692757 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.692890 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.693037 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.693170 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.693311 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.693454 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.693589 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.693730 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.693873 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.694006 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.694138 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.694270 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.694393 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.694523 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.694664 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.694798 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.694930 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.695061 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.695208 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.695361 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.695504 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.695620 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.695733 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.695865 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.696004 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.696128 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.696229 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.696461 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.696577 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.696753 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.696857 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.697069 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.697171 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.697379 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.697476 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.697745 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.697868 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.698003 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.698135 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.698304 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.698400 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.698613 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.698716 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.698916 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.699001 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.699223 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.699328 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.699554 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.699661 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.699864 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.699971 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.700190 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.700286 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.700503 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.700612 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.700807 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.700905 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.701118 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.701219 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.701421 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.701603 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.701777 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.701927 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.702074 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.702228 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.702496 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.702795 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.702960 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.703109 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.703109 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.703435 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.703435 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.703748 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.703903 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.704050 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.704202 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.704349 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.704502 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.704657 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.704804 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.704957 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.705103 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.705255 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.705414 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.705561 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.705717 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.706376 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.706376 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.706545 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.706647 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.706741 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.706835 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.706922 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.707007 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.707100 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.707186 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.707279 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.707406 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.707494 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.707587 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.707685 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.707785 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.707878 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.708099 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.708205 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.708407 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.708513 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.708729 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.708823 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.709051 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.709143 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.709361 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.709468 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.709664 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.709756 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.709974 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.710063 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.710284 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.710399 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.710591 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.710685 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.710899 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.710990 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.711212 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.711343 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.711546 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.711639 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.711858 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.711962 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.712171 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.712264 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.712485 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.712584 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.712800 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.712901 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.713110 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.713213 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.713427 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.713529 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.713743 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.713837 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.714058 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.714154 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.714372 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.714465 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.714927 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.715119 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.715342 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.715437 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.715956 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.716051 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.716138 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.716239 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.716328 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.716791 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.716871 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.716944 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.717017 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.717101 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.717184 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.717356 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.717452 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.717631 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.717734 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.717940 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.718040 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.718254 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.718360 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.718561 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.718665 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.718877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.719007 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.719181 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.719352 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.719629 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.719733 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.719944 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.720045 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.720304 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.720412 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.720613 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.720721 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.720919 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.721020 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.721228 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.721335 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.721539 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.721643 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.721864 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.721975 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.722166 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.722260 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.722470 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.722564 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.722773 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.722919 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.723096 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.723199 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.723425 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.723522 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.723749 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.723967 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.724117 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.724222 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.724427 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.724529 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.724740 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.724833 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.725049 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.725183 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.725376 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.725478 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.725685 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.725786 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.726010 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.726124 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.726374 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.726472 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.726698 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.726794 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.727002 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.727109 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.727354 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.727509 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.727684 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.727793 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.727979 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.728085 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.728312 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.728457 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.728622 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.728771 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.728936 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.729032 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.729241 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.729342 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.729565 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.729672 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.729888 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.729989 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.730202 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.730328 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.730525 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.730632 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.730837 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.730937 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.731157 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.731259 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.732019 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.732131 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.732347 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.732450 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.732676 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.732776 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.732995 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.733133 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.733321 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.733420 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.733887 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.733990 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.734192 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.734313 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.734498 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.734631 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.734822 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.734962 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.735126 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.735294 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.735467 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.735623 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.735781 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.735933 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.736091 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.736248 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.736396 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.736555 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.736702 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.736879 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.737025 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.737180 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.737329 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.737491 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.737651 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.737804 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.737964 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.738122 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.738287 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.738437 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.738608 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.738747 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.738914 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.739057 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.739239 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.739394 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.739576 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.739704 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.739882 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.740026 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.740185 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.740327 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.740491 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.740655 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.740836 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.741013 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.741144 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.741502 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.741617 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.741729 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.741830 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.742047 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.742191 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.742358 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.742462 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.742669 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.742771 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.742981 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.743101 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.743350 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.743486 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.743668 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.743803 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.743995 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.744088 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.744308 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.744409 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.744616 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.744710 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.744929 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.745021 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.745236 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.745329 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.745541 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.745659 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.745849 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.745943 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.746160 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.746260 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.746466 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.746558 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.746771 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.746873 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.747122 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.747766 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.747988 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.748081 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.748297 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.748404 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.748653 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.748812 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.748962 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.749066 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.749269 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.749376 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.749574 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.749676 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.749882 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.749975 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.750201 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.750355 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.750532 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.750670 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.750851 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.750946 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.751182 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.751285 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.751523 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.751617 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.751835 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.751928 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.752147 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.752285 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.752459 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.752553 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.752787 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.752886 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.753108 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.753209 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.753427 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.753520 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.753748 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.753894 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.754068 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.754176 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.754388 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.754489 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.754704 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.754805 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.755016 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.755117 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.755356 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.755481 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.755678 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.755785 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.755997 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.756097 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.756323 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.756566 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.756667 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.756902 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.756996 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.757225 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.757326 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.757544 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.757636 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.757864 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.757965 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.758182 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.758274 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.758501 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.758670 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.758811 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.759061 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.759163 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.759420 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.759663 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.759776 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.760053 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.760154 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.760626 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.760727 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.760963 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.761185 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.761280 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.761599 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.761690 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.762185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.762288 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.762510 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.762666 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.762857 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.762992 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.763200 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.763553 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.763662 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.763892 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.764119 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.764239 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.764568 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.764747 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.764895 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.765092 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.765219 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.765545 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.765665 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.765911 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.766207 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.766310 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.766540 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.766757 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.766851 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.767174 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.767378 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.767522 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.767846 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.767953 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.768167 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.768268 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.768491 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.768591 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.768813 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.768990 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.769133 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.769454 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.769567 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.769774 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.770038 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.770141 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.770394 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.770495 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.770731 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.770833 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.771071 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.771172 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.771416 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.771532 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.771742 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.771836 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.772067 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.772178 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.772484 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.772612 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.772815 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.772966 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.773266 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.773417 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.773604 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.773760 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.773922 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.774080 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.774256 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.774414 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.774582 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.774680 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.774921 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.775094 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.775224 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.775391 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.775562 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.775657 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.775881 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.775985 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.776199 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.776302 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.776512 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.776605 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.776827 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.776932 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.777140 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.777234 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.777450 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.777541 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.777771 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.777863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.778084 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.778176 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.778437 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.778657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.778764 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.779022 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.779283 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.779419 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.779663 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.779766 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.779985 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.780087 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.780319 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.780420 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.780632 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.780735 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.780961 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.781060 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.781280 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.781415 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.781592 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.781712 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.781910 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.782000 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.782218 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.782312 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.782531 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.782638 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.782844 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.782939 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.783152 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.783242 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.783488 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.783599 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.783805 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.783906 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.784118 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.784229 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.784420 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.784513 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.784731 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.784832 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.785041 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.785141 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.785354 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.785446 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.785668 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.785770 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.785975 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.786110 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.786284 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.786379 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.786594 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.786694 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.786910 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.787011 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.787223 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.787354 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.787630 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.787734 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.787942 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.788035 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.788259 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.788361 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.788569 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.788662 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.788884 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.788994 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.789195 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.789299 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.789508 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.789607 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.789817 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.789924 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.790130 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.790224 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.790483 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.790576 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.790796 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.790899 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.791388 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.791496 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.791583 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.791668 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.791766 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.791869 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.792055 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.792157 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.792381 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.792474 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.792697 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.792798 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.793011 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.793103 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.793361 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.793580 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.793686 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.794445 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.794790 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.794894 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.795133 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.795226 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.795499 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.795606 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.795819 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.795921 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.796134 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.796236 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.796448 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.796606 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.796764 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.796863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.797075 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.797179 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.797392 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.797491 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.797706 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.797805 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.798019 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.798122 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.798332 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.798426 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.798645 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.798745 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.798958 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.799060 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.799271 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.799405 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.799608 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.799704 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.799921 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.800025 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.800234 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.800336 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.800547 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.800641 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.800869 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.800977 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.801178 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.801279 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.801489 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.801590 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.801804 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.801897 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.802152 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.802245 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.802474 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.802574 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.802792 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.802882 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.803106 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.803204 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.803446 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.803560 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.803765 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.803863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.804076 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.804169 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.804388 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.804490 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.804700 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.804804 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.805018 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.805118 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.805330 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.805463 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.805689 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.805782 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.806076 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.806167 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.806405 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.806507 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.806736 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.806837 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.807054 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.807147 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.807410 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.807508 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.807743 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.807846 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.808064 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.808168 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.808388 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.808478 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.808702 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.808793 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.809024 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.809131 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.809339 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.809440 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.810217 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.810405 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.810566 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.810674 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.810899 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.810992 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.811226 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.811336 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.811561 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.811656 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.811868 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.811961 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.812180 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.812280 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.812492 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.812593 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.812802 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.812932 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.813111 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.813211 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.813457 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.813605 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.813821 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.813921 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.814067 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.814240 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.814368 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.814488 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.814607 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.814791 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.814920 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.815110 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.815239 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.815426 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.815543 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.815740 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.815869 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.816047 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.816167 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.816350 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.816470 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.816656 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.816784 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.816960 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.817081 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.817264 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.817391 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.817568 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.817694 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.817876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.817996 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.818181 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.818301 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.818489 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.818617 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.818790 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.818955 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.819277 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.819609 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.819945 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.820135 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.820294 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.820486 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.820625 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.820840 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.820982 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.821175 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.821316 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.821524 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.821620 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.821856 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.821950 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.822197 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.822292 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.822524 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.822616 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.822842 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.822944 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.823158 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.823253 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.823534 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.823641 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.823850 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.823953 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.824162 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.824263 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.824475 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.824567 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.824786 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.824892 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.825098 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.825224 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.825452 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.825545 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.825784 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.825896 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.826113 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.826214 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.826423 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.826525 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.826754 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.826919 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.827068 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.827222 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.827461 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.827601 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.827698 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.827850 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.828013 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.828173 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.828345 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.828518 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.828659 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.828844 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.828971 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.829167 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.829289 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.829535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.829675 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.829796 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.829916 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.830123 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.830245 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.830531 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.830670 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.830791 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.830911 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.831091 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.831225 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.831457 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.831580 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.831780 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.831891 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.832115 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.832217 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.832448 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.832549 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.832778 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.832869 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.833120 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.833270 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.833449 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.833541 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.833769 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.833872 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.834104 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.834211 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.834420 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.834513 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.834666 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 01 04:26:42.834790 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:26:42.835044 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 01 04:26:42.895565 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO dbcounter [None req-783ae802-7bcd-4de4-9b71-1d948a91e1ac None None] Registered counter for database nova_api Jun 01 04:26:42.895996 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO dbcounter [None req-b1010f98-5e1b-432f-85b4-17c0a9c19181 None None] Registered counter for database nova_api Jun 01 04:26:42.915866 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_db.sqlalchemy.engines [None req-783ae802-7bcd-4de4-9b71-1d948a91e1ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118516) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 01 04:26:42.917341 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_db.sqlalchemy.engines [None req-b1010f98-5e1b-432f-85b4-17c0a9c19181 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 01 04:26:42.923096 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writer thread running {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 01 04:26:42.929210 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writer thread running {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 01 04:26:42.981162 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.context [None req-783ae802-7bcd-4de4-9b71-1d948a91e1ac None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f8c01473-0ed5-4371-bff6-91e2cece601b(cell1) {{(pid=118516) load_cells /opt/stack/nova/nova/context.py:464}} Jun 01 04:26:42.986236 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-783ae802-7bcd-4de4-9b71-1d948a91e1ac None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:26:42.987823 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-783ae802-7bcd-4de4-9b71-1d948a91e1ac None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:26:42.988366 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.context [None req-b1010f98-5e1b-432f-85b4-17c0a9c19181 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f8c01473-0ed5-4371-bff6-91e2cece601b(cell1) {{(pid=118517) load_cells /opt/stack/nova/nova/context.py:464}} Jun 01 04:26:42.988660 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-783ae802-7bcd-4de4-9b71-1d948a91e1ac None None] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:26:42.990647 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-783ae802-7bcd-4de4-9b71-1d948a91e1ac None None] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:26:42.992578 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b1010f98-5e1b-432f-85b4-17c0a9c19181 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:26:42.992746 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO dbcounter [None req-783ae802-7bcd-4de4-9b71-1d948a91e1ac None None] Registered counter for database nova_cell0 Jun 01 04:26:42.994247 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b1010f98-5e1b-432f-85b4-17c0a9c19181 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:26:42.995208 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b1010f98-5e1b-432f-85b4-17c0a9c19181 None None] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:26:42.996903 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO dbcounter [None req-783ae802-7bcd-4de4-9b71-1d948a91e1ac None None] Registered counter for database nova_cell1 Jun 01 04:26:42.997799 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b1010f98-5e1b-432f-85b4-17c0a9c19181 None None] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:26:43.001959 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO dbcounter [None req-b1010f98-5e1b-432f-85b4-17c0a9c19181 None None] Registered counter for database nova_cell0 Jun 01 04:26:43.004169 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO dbcounter [None req-b1010f98-5e1b-432f-85b4-17c0a9c19181 None None] Registered counter for database nova_cell1 Jun 01 04:26:43.004785 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_db.sqlalchemy.engines [None req-783ae802-7bcd-4de4-9b71-1d948a91e1ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118516) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 01 04:26:43.010821 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_db.sqlalchemy.engines [None req-783ae802-7bcd-4de4-9b71-1d948a91e1ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118516) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 01 04:26:43.013235 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_db.sqlalchemy.engines [None req-b1010f98-5e1b-432f-85b4-17c0a9c19181 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 01 04:26:43.015960 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_db.sqlalchemy.engines [None req-b1010f98-5e1b-432f-85b4-17c0a9c19181 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 01 04:26:43.016234 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writer thread running {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 01 04:26:43.023850 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writer thread running {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 01 04:26:43.024376 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writer thread running {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 01 04:26:43.168872 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writer thread running {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 01 04:26:43.176744 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO dbcounter [None req-b1010f98-5e1b-432f-85b4-17c0a9c19181 None None] Registered counter for database nova_cell0 Jun 01 04:26:43.178744 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO dbcounter [None req-783ae802-7bcd-4de4-9b71-1d948a91e1ac None None] Registered counter for database nova_cell0 Jun 01 04:26:43.184798 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_db.sqlalchemy.engines [None req-b1010f98-5e1b-432f-85b4-17c0a9c19181 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 01 04:26:43.188099 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_db.sqlalchemy.engines [None req-783ae802-7bcd-4de4-9b71-1d948a91e1ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118516) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 01 04:26:43.190140 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writer thread running {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 01 04:26:43.195798 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writer thread running {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 01 04:26:43.636462 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: WARNING keystonemiddleware.auth_token [None req-b1010f98-5e1b-432f-85b4-17c0a9c19181 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 01 04:26:43.644358 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: WARNING keystonemiddleware.auth_token [None req-b1010f98-5e1b-432f-85b4-17c0a9c19181 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 01 04:26:43.646674 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: WARNING keystonemiddleware.auth_token [None req-783ae802-7bcd-4de4-9b71-1d948a91e1ac None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 01 04:26:43.654891 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: WARNING keystonemiddleware.auth_token [None req-783ae802-7bcd-4de4-9b71-1d948a91e1ac None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 01 04:26:43.867846 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: WARNING keystonemiddleware.auth_token [None req-b1010f98-5e1b-432f-85b4-17c0a9c19181 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 01 04:26:43.874411 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: WARNING keystonemiddleware.auth_token [None req-b1010f98-5e1b-432f-85b4-17c0a9c19181 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 01 04:26:43.879403 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: WARNING keystonemiddleware.auth_token [None req-783ae802-7bcd-4de4-9b71-1d948a91e1ac None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 01 04:26:43.879625 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c15146c9c0 pid: 118517 (default app) Jun 01 04:26:43.885375 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: WARNING keystonemiddleware.auth_token [None req-783ae802-7bcd-4de4-9b71-1d948a91e1ac None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 01 04:26:43.891060 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c15146c9c0 pid: 118516 (default app) Jun 01 04:27:26.175418 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_api:SELECT=3 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:26.176406 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=3 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:26.177357 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell0:SELECT=3 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:26.178250 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell0:SELECT=3 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:26.437847 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_api:SELECT=3 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:26.438703 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=3 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:26.439541 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell0:SELECT=3 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:26.440465 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell0:SELECT=3 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:27.579971 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-9d8daca8-302e-4fb0-bc76-5db2c75e15ea tempest-VolumesNegativeTest-774364669 tempest-VolumesNegativeTest-774364669-project] Action: 'create', calling method: .version_select at 0x7ff3278d5310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1881292516", "metadata": {"Type": "work"}}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:27:27.601049 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-9d8daca8-302e-4fb0-bc76-5db2c75e15ea tempest-VolumesNegativeTest-774364669 tempest-VolumesNegativeTest-774364669-project] Request method failure captured: Jun 01 04:27:27.601049 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 01 04:27:27.601049 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept: application/json Jun 01 04:27:27.601049 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept-Encoding: identity Jun 01 04:27:27.601049 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Connection: close Jun 01 04:27:27.601049 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Length: 122 Jun 01 04:27:27.601049 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Type: application/json Jun 01 04:27:27.601049 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Host: 10.222.0.18 Jun 01 04:27:27.601049 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Openstack-System-Scope: None Jun 01 04:27:27.601049 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: User-Agent: python-urllib3/1.26.9 Jun 01 04:27:27.601049 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Auth-Token: gAAAAABiluqumY5T_gtgb5xb8zKqssQx9IVdvbrd9BxtWXpycCINJtJAD93PzsJYAc9eG_LVz8z67ZDfqHmPno2-zMxO8OJnvZXgXOG3wpoS2zO0lbD0rPUvIbrEjS7oA3qdLAyP7r8vTgETerR3JnXpwR7cKXilMnl2WPwoUo92sXlW9I47_m4 Jun 01 04:27:27.601049 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Id: None Jun 01 04:27:27.601049 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Name: None Jun 01 04:27:27.601049 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Identity-Status: Confirmed Jun 01 04:27:27.601049 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Is-Admin-Project: True Jun 01 04:27:27.601049 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Id: default Jun 01 04:27:27.601049 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Name: Default Jun 01 04:27:27.601049 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Id: 7cef434ad11449bf91a4e809384fd02a Jun 01 04:27:27.601049 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Name: tempest-VolumesNegativeTest-774364669 Jun 01 04:27:27.601049 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Role: reader,member Jun 01 04:27:27.601049 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Roles: reader,member Jun 01 04:27:27.602726 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7cef434ad11449bf91a4e809384fd02a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7cef434ad11449bf91a4e809384fd02a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7cef434ad11449bf91a4e809384fd02a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7cef434ad11449bf91a4e809384fd02a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:27:27.602726 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant: tempest-VolumesNegativeTest-774364669 Jun 01 04:27:27.602726 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Id: 7cef434ad11449bf91a4e809384fd02a Jun 01 04:27:27.602726 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Name: tempest-VolumesNegativeTest-774364669 Jun 01 04:27:27.602726 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User: tempest-VolumesNegativeTest-774364669-project Jun 01 04:27:27.602726 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Id: default Jun 01 04:27:27.602726 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Name: Default Jun 01 04:27:27.602726 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Id: 1564a394b8b74a9fab20facd7f91a125 Jun 01 04:27:27.602726 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Name: tempest-VolumesNegativeTest-774364669-project Jun 01 04:27:27.602726 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Jun 01 04:27:27.602726 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1881292516", "metadata": {"Type": "work"}}} Jun 01 04:27:27.602726 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: method: Jun 01 04:27:27.602726 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 01 04:27:27.603754 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1881292516', 'metadata': {'Type': 'work'}}}} Jun 01 04:27:27.603754 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:27:27.603754 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:27.603754 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 01 04:27:27.603754 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 01 04:27:27.603754 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 01 04:27:27.603754 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise error Jun 01 04:27:27.603754 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 01 04:27:27.603754 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:27.603754 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 01 04:27:27.603754 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 01 04:27:27.603754 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:27.603754 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 01 04:27:27.603754 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi '#$%' Jun 01 04:27:27.603754 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:27.603754 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:27:27.603754 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:27.603754 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:27.603754 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:27:27.603754 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:27:27.603754 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:27:27.603754 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:27:27.605416 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 01 04:27:27.605416 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 01 04:27:27.605416 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:27:27.605416 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:27:27.605416 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 01 04:27:27.605416 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 01 04:27:27.605416 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 01 04:27:27.605416 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 01 04:27:27.605416 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 01 04:27:27.605416 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 01 04:27:27.605416 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 01 04:27:27.605416 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:27.605416 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:27:27.605416 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:27.605416 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:27.605416 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:27:27.605416 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:27:27.605416 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 01 04:27:27.605416 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 01 04:27:27.606905 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 01 04:27:27.606905 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:27.606905 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-9d8daca8-302e-4fb0-bc76-5db2c75e15ea tempest-VolumesNegativeTest-774364669 tempest-VolumesNegativeTest-774364669-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:27:27.608129 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-9d8daca8-302e-4fb0-bc76-5db2c75e15ea tempest-VolumesNegativeTest-774364669 tempest-VolumesNegativeTest-774364669-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.445781 Jun 01 04:27:27.609193 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 1/1] 10.222.0.18 () {60 vars in 1155 bytes} [Wed Jun 1 04:27:26 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1449 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 01 04:27:27.622088 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-d47c6550-e51d-47f8-a20d-368df6565d1a tempest-VolumesNegativeTest-774364669 tempest-VolumesNegativeTest-774364669-project] Action: 'create', calling method: .version_select at 0x7ff327773670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-304547930", "metadata": {"Type": "work"}}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:27:27.625312 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-d47c6550-e51d-47f8-a20d-368df6565d1a tempest-VolumesNegativeTest-774364669 tempest-VolumesNegativeTest-774364669-project] Request method failure captured: Jun 01 04:27:27.625312 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 01 04:27:27.625312 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept: application/json Jun 01 04:27:27.625312 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept-Encoding: identity Jun 01 04:27:27.625312 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Connection: close Jun 01 04:27:27.625312 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Length: 119 Jun 01 04:27:27.625312 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Type: application/json Jun 01 04:27:27.625312 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Host: 10.222.0.18 Jun 01 04:27:27.625312 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Openstack-System-Scope: None Jun 01 04:27:27.625312 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: User-Agent: python-urllib3/1.26.9 Jun 01 04:27:27.625312 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Auth-Token: gAAAAABiluqumY5T_gtgb5xb8zKqssQx9IVdvbrd9BxtWXpycCINJtJAD93PzsJYAc9eG_LVz8z67ZDfqHmPno2-zMxO8OJnvZXgXOG3wpoS2zO0lbD0rPUvIbrEjS7oA3qdLAyP7r8vTgETerR3JnXpwR7cKXilMnl2WPwoUo92sXlW9I47_m4 Jun 01 04:27:27.625312 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Id: None Jun 01 04:27:27.625312 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Name: None Jun 01 04:27:27.625312 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Identity-Status: Confirmed Jun 01 04:27:27.625312 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Is-Admin-Project: True Jun 01 04:27:27.625312 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Id: default Jun 01 04:27:27.625312 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Name: Default Jun 01 04:27:27.625312 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Id: 7cef434ad11449bf91a4e809384fd02a Jun 01 04:27:27.625312 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Name: tempest-VolumesNegativeTest-774364669 Jun 01 04:27:27.625312 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Role: reader,member Jun 01 04:27:27.625312 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Roles: reader,member Jun 01 04:27:27.626673 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7cef434ad11449bf91a4e809384fd02a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7cef434ad11449bf91a4e809384fd02a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7cef434ad11449bf91a4e809384fd02a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7cef434ad11449bf91a4e809384fd02a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:27:27.626673 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant: tempest-VolumesNegativeTest-774364669 Jun 01 04:27:27.626673 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Id: 7cef434ad11449bf91a4e809384fd02a Jun 01 04:27:27.626673 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Name: tempest-VolumesNegativeTest-774364669 Jun 01 04:27:27.626673 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User: tempest-VolumesNegativeTest-774364669-project Jun 01 04:27:27.626673 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Id: default Jun 01 04:27:27.626673 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Name: Default Jun 01 04:27:27.626673 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Id: 1564a394b8b74a9fab20facd7f91a125 Jun 01 04:27:27.626673 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Name: tempest-VolumesNegativeTest-774364669-project Jun 01 04:27:27.626673 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Jun 01 04:27:27.626673 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-304547930", "metadata": {"Type": "work"}}} Jun 01 04:27:27.626673 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: method: Jun 01 04:27:27.626673 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 01 04:27:27.628573 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-304547930', 'metadata': {'Type': 'work'}}}} Jun 01 04:27:27.628573 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:27:27.628573 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:27.628573 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 01 04:27:27.628573 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 01 04:27:27.628573 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 01 04:27:27.628573 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise error Jun 01 04:27:27.628573 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 01 04:27:27.628573 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:27.628573 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 01 04:27:27.628573 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 01 04:27:27.628573 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:27.628573 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 01 04:27:27.628573 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi '0' Jun 01 04:27:27.628573 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:27.628573 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:27:27.628573 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:27.628573 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:27.628573 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:27:27.628573 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:27:27.628573 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:27:27.628573 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:27:27.632890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 01 04:27:27.632890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 01 04:27:27.632890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:27:27.632890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:27:27.632890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 01 04:27:27.632890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 01 04:27:27.632890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 01 04:27:27.632890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 01 04:27:27.632890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 01 04:27:27.632890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 01 04:27:27.632890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 01 04:27:27.632890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:27.632890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:27:27.632890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:27.632890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:27.632890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:27:27.632890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:27:27.632890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 01 04:27:27.632890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 01 04:27:27.635475 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 01 04:27:27.635475 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:27.635475 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-d47c6550-e51d-47f8-a20d-368df6565d1a tempest-VolumesNegativeTest-774364669 tempest-VolumesNegativeTest-774364669-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:27:27.635475 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-d47c6550-e51d-47f8-a20d-368df6565d1a tempest-VolumesNegativeTest-774364669 tempest-VolumesNegativeTest-774364669-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018672 Jun 01 04:27:27.639542 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 2/2] 10.222.0.18 () {60 vars in 1155 bytes} [Wed Jun 1 04:27:27 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 01 04:27:27.647197 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a5aa49f8-6013-4ba6-89a9-1782199909bf tempest-VolumesNegativeTest-774364669 tempest-VolumesNegativeTest-774364669-project] Action: 'create', calling method: .version_select at 0x7ff3278d5670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1411468608", "metadata": {"Type": "work"}}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:27:27.651814 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a5aa49f8-6013-4ba6-89a9-1782199909bf tempest-VolumesNegativeTest-774364669 tempest-VolumesNegativeTest-774364669-project] Request method failure captured: Jun 01 04:27:27.651814 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 01 04:27:27.651814 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept: application/json Jun 01 04:27:27.651814 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept-Encoding: identity Jun 01 04:27:27.651814 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Connection: close Jun 01 04:27:27.651814 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Length: 119 Jun 01 04:27:27.651814 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Type: application/json Jun 01 04:27:27.651814 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Host: 10.222.0.18 Jun 01 04:27:27.651814 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Openstack-System-Scope: None Jun 01 04:27:27.651814 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: User-Agent: python-urllib3/1.26.9 Jun 01 04:27:27.651814 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Auth-Token: gAAAAABiluqumY5T_gtgb5xb8zKqssQx9IVdvbrd9BxtWXpycCINJtJAD93PzsJYAc9eG_LVz8z67ZDfqHmPno2-zMxO8OJnvZXgXOG3wpoS2zO0lbD0rPUvIbrEjS7oA3qdLAyP7r8vTgETerR3JnXpwR7cKXilMnl2WPwoUo92sXlW9I47_m4 Jun 01 04:27:27.651814 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Id: None Jun 01 04:27:27.651814 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Name: None Jun 01 04:27:27.651814 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Identity-Status: Confirmed Jun 01 04:27:27.651814 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Is-Admin-Project: True Jun 01 04:27:27.651814 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Id: default Jun 01 04:27:27.651814 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Name: Default Jun 01 04:27:27.651814 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Id: 7cef434ad11449bf91a4e809384fd02a Jun 01 04:27:27.651814 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Name: tempest-VolumesNegativeTest-774364669 Jun 01 04:27:27.651814 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Role: reader,member Jun 01 04:27:27.651814 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Roles: reader,member Jun 01 04:27:27.653166 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7cef434ad11449bf91a4e809384fd02a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7cef434ad11449bf91a4e809384fd02a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7cef434ad11449bf91a4e809384fd02a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7cef434ad11449bf91a4e809384fd02a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:27:27.653166 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant: tempest-VolumesNegativeTest-774364669 Jun 01 04:27:27.653166 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Id: 7cef434ad11449bf91a4e809384fd02a Jun 01 04:27:27.653166 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Name: tempest-VolumesNegativeTest-774364669 Jun 01 04:27:27.653166 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User: tempest-VolumesNegativeTest-774364669-project Jun 01 04:27:27.653166 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Id: default Jun 01 04:27:27.653166 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Name: Default Jun 01 04:27:27.653166 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Id: 1564a394b8b74a9fab20facd7f91a125 Jun 01 04:27:27.653166 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Name: tempest-VolumesNegativeTest-774364669-project Jun 01 04:27:27.653166 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Jun 01 04:27:27.653166 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1411468608", "metadata": {"Type": "work"}}} Jun 01 04:27:27.653166 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: method: Jun 01 04:27:27.653166 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 01 04:27:27.653959 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1411468608', 'metadata': {'Type': 'work'}}}} Jun 01 04:27:27.653959 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:27:27.653959 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:27.653959 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 01 04:27:27.653959 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 01 04:27:27.653959 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 01 04:27:27.653959 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise error Jun 01 04:27:27.653959 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 01 04:27:27.653959 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:27.653959 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 01 04:27:27.653959 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 01 04:27:27.653959 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:27.653959 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 01 04:27:27.653959 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi '' Jun 01 04:27:27.653959 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:27.653959 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:27:27.653959 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:27.653959 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:27.653959 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:27:27.653959 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:27:27.653959 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:27:27.653959 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:27:27.655267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 01 04:27:27.655267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 01 04:27:27.655267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:27:27.655267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:27:27.655267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 01 04:27:27.655267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 01 04:27:27.655267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 01 04:27:27.655267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 01 04:27:27.655267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 01 04:27:27.655267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 01 04:27:27.655267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 01 04:27:27.655267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:27.655267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:27:27.655267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:27.655267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:27.655267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:27:27.655267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:27:27.655267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 01 04:27:27.655267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 01 04:27:27.658620 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 01 04:27:27.658620 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:27.659012 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a5aa49f8-6013-4ba6-89a9-1782199909bf tempest-VolumesNegativeTest-774364669 tempest-VolumesNegativeTest-774364669-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:27:27.661079 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-a5aa49f8-6013-4ba6-89a9-1782199909bf tempest-VolumesNegativeTest-774364669 tempest-VolumesNegativeTest-774364669-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.019159 Jun 01 04:27:27.665841 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 3/3] 10.222.0.18 () {60 vars in 1155 bytes} [Wed Jun 1 04:27:27 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 01 04:27:27.683786 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-4f805302-acff-4464-9e0d-c0e43a9f6b11 tempest-VolumesNegativeTest-774364669 tempest-VolumesNegativeTest-774364669-project] Calling method '.version_select at 0x7ff3277843a0>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:27.896564 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-8f9de3f3-bbc9-4846-b0eb-da9967b92ff0 tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] Action: 'create', calling method: .version_select at 0x7ff3278d73a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-35039585"}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:27:28.657754 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.wsgi [None req-4f805302-acff-4464-9e0d-c0e43a9f6b11 tempest-VolumesNegativeTest-774364669 tempest-VolumesNegativeTest-774364669-project] HTTP exception thrown: Volume tempest-invalid-1993512481 could not be found. Jun 01 04:27:28.661876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-4f805302-acff-4464-9e0d-c0e43a9f6b11 tempest-VolumesNegativeTest-774364669 tempest-VolumesNegativeTest-774364669-project] Request method failure captured: Jun 01 04:27:28.661876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1993512481 HTTP/1.1 Jun 01 04:27:28.661876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept: application/json Jun 01 04:27:28.661876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept-Encoding: identity Jun 01 04:27:28.661876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Connection: close Jun 01 04:27:28.661876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Length: 0 Jun 01 04:27:28.661876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Type: application/json Jun 01 04:27:28.661876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Host: 10.222.0.18 Jun 01 04:27:28.661876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Openstack-System-Scope: None Jun 01 04:27:28.661876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: User-Agent: python-urllib3/1.26.9 Jun 01 04:27:28.661876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Auth-Token: gAAAAABiluqumY5T_gtgb5xb8zKqssQx9IVdvbrd9BxtWXpycCINJtJAD93PzsJYAc9eG_LVz8z67ZDfqHmPno2-zMxO8OJnvZXgXOG3wpoS2zO0lbD0rPUvIbrEjS7oA3qdLAyP7r8vTgETerR3JnXpwR7cKXilMnl2WPwoUo92sXlW9I47_m4 Jun 01 04:27:28.661876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Id: None Jun 01 04:27:28.661876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Name: None Jun 01 04:27:28.661876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Identity-Status: Confirmed Jun 01 04:27:28.661876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Is-Admin-Project: True Jun 01 04:27:28.661876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Id: default Jun 01 04:27:28.661876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Name: Default Jun 01 04:27:28.661876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Id: 7cef434ad11449bf91a4e809384fd02a Jun 01 04:27:28.661876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Name: tempest-VolumesNegativeTest-774364669 Jun 01 04:27:28.661876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Role: reader,member Jun 01 04:27:28.661876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Roles: reader,member Jun 01 04:27:28.663652 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7cef434ad11449bf91a4e809384fd02a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7cef434ad11449bf91a4e809384fd02a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7cef434ad11449bf91a4e809384fd02a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7cef434ad11449bf91a4e809384fd02a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:27:28.663652 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant: tempest-VolumesNegativeTest-774364669 Jun 01 04:27:28.663652 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Id: 7cef434ad11449bf91a4e809384fd02a Jun 01 04:27:28.663652 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Name: tempest-VolumesNegativeTest-774364669 Jun 01 04:27:28.663652 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User: tempest-VolumesNegativeTest-774364669-project Jun 01 04:27:28.663652 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Id: default Jun 01 04:27:28.663652 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Name: Default Jun 01 04:27:28.663652 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Id: 1564a394b8b74a9fab20facd7f91a125 Jun 01 04:27:28.663652 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Name: tempest-VolumesNegativeTest-774364669-project Jun 01 04:27:28.663652 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: method: Jun 01 04:27:28.663652 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: exception: Volume tempest-invalid-1993512481 could not be found. Jun 01 04:27:28.663652 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: action_args: {'id': 'tempest-invalid-1993512481'} Jun 01 04:27:28.663652 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:27:28.664591 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:28.664591 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 01 04:27:28.664591 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 01 04:27:28.664591 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 01 04:27:28.664591 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 01 04:27:28.664591 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 01 04:27:28.664591 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 01 04:27:28.664591 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 01 04:27:28.664591 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 01 04:27:28.664591 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 01 04:27:28.664591 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 01 04:27:28.664591 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 01 04:27:28.664591 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 01 04:27:28.664591 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 01 04:27:28.664591 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 01 04:27:28.664591 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1993512481 could not be found. (HTTP 404) (Request-ID: req-79cce038-ba25-4291-81e3-1ec7aa02f95a) Jun 01 04:27:28.664591 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:28.664591 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:27:28.664591 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:28.665816 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:28.665816 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 01 04:27:28.665816 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 01 04:27:28.665816 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 01 04:27:28.665816 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 01 04:27:28.665816 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 01 04:27:28.665816 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 01 04:27:28.665816 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 01 04:27:28.665816 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 01 04:27:28.665816 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 01 04:27:28.665816 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 01 04:27:28.665816 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 01 04:27:28.665816 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 01 04:27:28.665816 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 01 04:27:28.665816 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 01 04:27:28.665816 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 01 04:27:28.665816 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 01 04:27:28.665816 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 01 04:27:28.665816 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 01 04:27:28.668844 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 01 04:27:28.668844 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 01 04:27:28.668844 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 01 04:27:28.668844 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 01 04:27:28.668844 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1993512481 could not be found. Jun 01 04:27:28.668844 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:28.668844 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:27:28.668844 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:28.668844 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:28.668844 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:27:28.668844 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:27:28.668844 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:27:28.668844 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:27:28.668844 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 01 04:27:28.668844 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 01 04:27:28.668844 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:27:28.668844 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:27:28.668844 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 01 04:27:28.668844 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:27:28.668844 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1993512481 could not be found. Jun 01 04:27:28.670410 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:28.670410 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:27:28.670410 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:28.670410 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:28.670410 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:27:28.670410 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:27:28.670410 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:27:28.670410 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:27:28.670410 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1993512481 could not be found. Jun 01 04:27:28.670410 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:28.670410 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-4f805302-acff-4464-9e0d-c0e43a9f6b11 tempest-VolumesNegativeTest-774364669 tempest-VolumesNegativeTest-774364669-project] Returning 404 to user: Volume tempest-invalid-1993512481 could not be found. {{(pid=118517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:27:28.670410 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-4f805302-acff-4464-9e0d-c0e43a9f6b11 tempest-VolumesNegativeTest-774364669 tempest-VolumesNegativeTest-774364669-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1993512481" status: 404 len: 99 microversion: 2.1 time: 0.991141 Jun 01 04:27:28.670410 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 4/4] 10.222.0.18 () {58 vars in 1217 bytes} [Wed Jun 1 04:27:27 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1993512481 => generated 99 bytes in 995 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 01 04:27:28.685260 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-5af32189-11aa-43d7-af1a-a8d88aa36f6e tempest-VolumesNegativeTest-774364669 tempest-VolumesNegativeTest-774364669-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010426 Jun 01 04:27:28.690660 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 5/5] 10.222.0.18 () {58 vars in 1139 bytes} [Wed Jun 1 04:27:28 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 01 04:27:28.698342 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-6bab4aa9-1c60-42b1-8184-1f82d7672610 tempest-VolumesNegativeTest-774364669 tempest-VolumesNegativeTest-774364669-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005900 Jun 01 04:27:28.702047 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 6/6] 10.222.0.18 () {58 vars in 1136 bytes} [Wed Jun 1 04:27:28 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 01 04:27:28.716949 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-88cfd5dc-d0d3-4896-a72e-03b9711d5334 tempest-VolumesNegativeTest-774364669 tempest-VolumesNegativeTest-774364669-project] Calling method '.version_select at 0x7ff3276af790>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:29.070462 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.wsgi [None req-88cfd5dc-d0d3-4896-a72e-03b9711d5334 tempest-VolumesNegativeTest-774364669 tempest-VolumesNegativeTest-774364669-project] HTTP exception thrown: Volume ed6bdc14-f4fb-4687-b062-2507feef8eb7 could not be found. Jun 01 04:27:29.072943 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-88cfd5dc-d0d3-4896-a72e-03b9711d5334 tempest-VolumesNegativeTest-774364669 tempest-VolumesNegativeTest-774364669-project] Request method failure captured: Jun 01 04:27:29.072943 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: request: DELETE /compute/v2.1/os-volumes/ed6bdc14-f4fb-4687-b062-2507feef8eb7 HTTP/1.1 Jun 01 04:27:29.072943 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept: application/json Jun 01 04:27:29.072943 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept-Encoding: identity Jun 01 04:27:29.072943 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Connection: close Jun 01 04:27:29.072943 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Length: 0 Jun 01 04:27:29.072943 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Type: application/json Jun 01 04:27:29.072943 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Host: 10.222.0.18 Jun 01 04:27:29.072943 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Openstack-System-Scope: None Jun 01 04:27:29.072943 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: User-Agent: python-urllib3/1.26.9 Jun 01 04:27:29.072943 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Auth-Token: gAAAAABiluqumY5T_gtgb5xb8zKqssQx9IVdvbrd9BxtWXpycCINJtJAD93PzsJYAc9eG_LVz8z67ZDfqHmPno2-zMxO8OJnvZXgXOG3wpoS2zO0lbD0rPUvIbrEjS7oA3qdLAyP7r8vTgETerR3JnXpwR7cKXilMnl2WPwoUo92sXlW9I47_m4 Jun 01 04:27:29.072943 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Id: None Jun 01 04:27:29.072943 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Name: None Jun 01 04:27:29.072943 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Identity-Status: Confirmed Jun 01 04:27:29.072943 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Is-Admin-Project: True Jun 01 04:27:29.072943 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Id: default Jun 01 04:27:29.072943 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Name: Default Jun 01 04:27:29.072943 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Id: 7cef434ad11449bf91a4e809384fd02a Jun 01 04:27:29.072943 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Name: tempest-VolumesNegativeTest-774364669 Jun 01 04:27:29.072943 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Role: reader,member Jun 01 04:27:29.072943 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Roles: reader,member Jun 01 04:27:29.075098 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7cef434ad11449bf91a4e809384fd02a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7cef434ad11449bf91a4e809384fd02a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7cef434ad11449bf91a4e809384fd02a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7cef434ad11449bf91a4e809384fd02a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:27:29.075098 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant: tempest-VolumesNegativeTest-774364669 Jun 01 04:27:29.075098 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Id: 7cef434ad11449bf91a4e809384fd02a Jun 01 04:27:29.075098 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Name: tempest-VolumesNegativeTest-774364669 Jun 01 04:27:29.075098 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User: tempest-VolumesNegativeTest-774364669-project Jun 01 04:27:29.075098 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Id: default Jun 01 04:27:29.075098 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Name: Default Jun 01 04:27:29.075098 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Id: 1564a394b8b74a9fab20facd7f91a125 Jun 01 04:27:29.075098 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Name: tempest-VolumesNegativeTest-774364669-project Jun 01 04:27:29.075098 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: method: Jun 01 04:27:29.075098 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: exception: Volume ed6bdc14-f4fb-4687-b062-2507feef8eb7 could not be found. Jun 01 04:27:29.075098 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: action_args: {'id': 'ed6bdc14-f4fb-4687-b062-2507feef8eb7'} Jun 01 04:27:29.075098 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:27:29.076278 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:29.076278 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 01 04:27:29.076278 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 01 04:27:29.076278 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 01 04:27:29.076278 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 01 04:27:29.076278 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 01 04:27:29.076278 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 01 04:27:29.076278 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 01 04:27:29.076278 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 01 04:27:29.076278 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 01 04:27:29.076278 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 01 04:27:29.076278 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 01 04:27:29.076278 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 01 04:27:29.076278 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 01 04:27:29.076278 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 01 04:27:29.076278 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ed6bdc14-f4fb-4687-b062-2507feef8eb7 could not be found. (HTTP 404) (Request-ID: req-aaed107f-114d-482e-b795-ff2d2481e7ff) Jun 01 04:27:29.076278 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:29.076278 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:27:29.076278 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:29.077668 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:29.077668 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 01 04:27:29.077668 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 01 04:27:29.077668 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 01 04:27:29.077668 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 01 04:27:29.077668 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 01 04:27:29.077668 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 01 04:27:29.077668 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 01 04:27:29.077668 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 01 04:27:29.077668 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 01 04:27:29.077668 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 01 04:27:29.077668 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 01 04:27:29.077668 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 01 04:27:29.077668 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 01 04:27:29.077668 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 01 04:27:29.077668 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 01 04:27:29.077668 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 01 04:27:29.077668 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 01 04:27:29.077668 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 01 04:27:29.079034 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 01 04:27:29.079034 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 01 04:27:29.079034 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 01 04:27:29.079034 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 01 04:27:29.079034 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ed6bdc14-f4fb-4687-b062-2507feef8eb7 could not be found. Jun 01 04:27:29.079034 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:29.079034 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:27:29.079034 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:29.079034 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:29.079034 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:27:29.079034 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:27:29.079034 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:27:29.079034 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:27:29.079034 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 01 04:27:29.079034 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 01 04:27:29.079034 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:27:29.079034 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:27:29.079034 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 01 04:27:29.079034 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:27:29.080431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ed6bdc14-f4fb-4687-b062-2507feef8eb7 could not be found. Jun 01 04:27:29.080431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:29.080431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:27:29.080431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:29.080431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:29.080431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:27:29.080431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:27:29.080431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:27:29.080431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:27:29.080431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ed6bdc14-f4fb-4687-b062-2507feef8eb7 could not be found. Jun 01 04:27:29.080431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:29.080431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-88cfd5dc-d0d3-4896-a72e-03b9711d5334 tempest-VolumesNegativeTest-774364669 tempest-VolumesNegativeTest-774364669-project] Returning 404 to user: Volume ed6bdc14-f4fb-4687-b062-2507feef8eb7 could not be found. {{(pid=118517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:27:29.082224 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-88cfd5dc-d0d3-4896-a72e-03b9711d5334 tempest-VolumesNegativeTest-774364669 tempest-VolumesNegativeTest-774364669-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/ed6bdc14-f4fb-4687-b062-2507feef8eb7" status: 404 len: 109 microversion: 2.1 time: 0.371364 Jun 01 04:27:29.082500 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 7/7] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jun 1 04:27:28 2022] DELETE /compute/v2.1/os-volumes/ed6bdc14-f4fb-4687-b062-2507feef8eb7 => generated 109 bytes in 376 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 01 04:27:29.093913 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-b36b120e-c822-4a46-bafc-5d1368ad2d62 tempest-VolumesNegativeTest-774364669 tempest-VolumesNegativeTest-774364669-project] Calling method '.version_select at 0x7ff3276afdc0>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:29.517877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.wsgi [None req-b36b120e-c822-4a46-bafc-5d1368ad2d62 tempest-VolumesNegativeTest-774364669 tempest-VolumesNegativeTest-774364669-project] HTTP exception thrown: Volume c4ba8ec0-0a54-4698-8386-d59ef15ca0cc could not be found. Jun 01 04:27:29.517877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-b36b120e-c822-4a46-bafc-5d1368ad2d62 tempest-VolumesNegativeTest-774364669 tempest-VolumesNegativeTest-774364669-project] Request method failure captured: Jun 01 04:27:29.517877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: request: GET /compute/v2.1/os-volumes/c4ba8ec0-0a54-4698-8386-d59ef15ca0cc HTTP/1.1 Jun 01 04:27:29.517877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept: application/json Jun 01 04:27:29.517877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept-Encoding: identity Jun 01 04:27:29.517877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Connection: close Jun 01 04:27:29.517877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Length: 0 Jun 01 04:27:29.517877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Type: application/json Jun 01 04:27:29.517877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Host: 10.222.0.18 Jun 01 04:27:29.517877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Openstack-System-Scope: None Jun 01 04:27:29.517877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: User-Agent: python-urllib3/1.26.9 Jun 01 04:27:29.517877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Auth-Token: gAAAAABiluqumY5T_gtgb5xb8zKqssQx9IVdvbrd9BxtWXpycCINJtJAD93PzsJYAc9eG_LVz8z67ZDfqHmPno2-zMxO8OJnvZXgXOG3wpoS2zO0lbD0rPUvIbrEjS7oA3qdLAyP7r8vTgETerR3JnXpwR7cKXilMnl2WPwoUo92sXlW9I47_m4 Jun 01 04:27:29.517877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Id: None Jun 01 04:27:29.517877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Name: None Jun 01 04:27:29.517877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Identity-Status: Confirmed Jun 01 04:27:29.517877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Is-Admin-Project: True Jun 01 04:27:29.517877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Id: default Jun 01 04:27:29.517877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Name: Default Jun 01 04:27:29.517877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Id: 7cef434ad11449bf91a4e809384fd02a Jun 01 04:27:29.517877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Name: tempest-VolumesNegativeTest-774364669 Jun 01 04:27:29.517877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Role: reader,member Jun 01 04:27:29.517877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Roles: reader,member Jun 01 04:27:29.523142 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7cef434ad11449bf91a4e809384fd02a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7cef434ad11449bf91a4e809384fd02a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7cef434ad11449bf91a4e809384fd02a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7cef434ad11449bf91a4e809384fd02a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:27:29.523142 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant: tempest-VolumesNegativeTest-774364669 Jun 01 04:27:29.523142 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Id: 7cef434ad11449bf91a4e809384fd02a Jun 01 04:27:29.523142 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Name: tempest-VolumesNegativeTest-774364669 Jun 01 04:27:29.523142 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User: tempest-VolumesNegativeTest-774364669-project Jun 01 04:27:29.523142 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Id: default Jun 01 04:27:29.523142 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Name: Default Jun 01 04:27:29.523142 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Id: 1564a394b8b74a9fab20facd7f91a125 Jun 01 04:27:29.523142 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Name: tempest-VolumesNegativeTest-774364669-project Jun 01 04:27:29.523142 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: method: Jun 01 04:27:29.523142 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: exception: Volume c4ba8ec0-0a54-4698-8386-d59ef15ca0cc could not be found. Jun 01 04:27:29.523142 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: action_args: {'id': 'c4ba8ec0-0a54-4698-8386-d59ef15ca0cc'} Jun 01 04:27:29.523142 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:27:29.532440 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:29.532440 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 01 04:27:29.532440 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 01 04:27:29.532440 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 01 04:27:29.532440 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 01 04:27:29.532440 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 01 04:27:29.532440 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 01 04:27:29.532440 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 01 04:27:29.532440 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 01 04:27:29.532440 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 01 04:27:29.532440 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 01 04:27:29.532440 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 01 04:27:29.532440 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 01 04:27:29.532440 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 01 04:27:29.532440 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 01 04:27:29.532440 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c4ba8ec0-0a54-4698-8386-d59ef15ca0cc could not be found. (HTTP 404) (Request-ID: req-72d50af7-32ff-4d97-8154-7ccb95ebf924) Jun 01 04:27:29.532440 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:29.532440 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:27:29.532440 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:29.537821 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:29.537821 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 01 04:27:29.537821 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 01 04:27:29.537821 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 01 04:27:29.537821 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 01 04:27:29.537821 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 01 04:27:29.537821 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 01 04:27:29.537821 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 01 04:27:29.537821 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 01 04:27:29.537821 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 01 04:27:29.537821 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 01 04:27:29.537821 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 01 04:27:29.537821 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 01 04:27:29.537821 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 01 04:27:29.537821 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 01 04:27:29.537821 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 01 04:27:29.537821 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 01 04:27:29.537821 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 01 04:27:29.537821 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 01 04:27:29.546563 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 01 04:27:29.546563 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 01 04:27:29.546563 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 01 04:27:29.546563 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 01 04:27:29.546563 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c4ba8ec0-0a54-4698-8386-d59ef15ca0cc could not be found. Jun 01 04:27:29.546563 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:29.546563 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:27:29.546563 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:29.546563 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:29.546563 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:27:29.546563 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:27:29.546563 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:27:29.546563 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:27:29.546563 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 01 04:27:29.546563 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 01 04:27:29.546563 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:27:29.546563 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:27:29.546563 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 01 04:27:29.546563 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:27:29.548502 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c4ba8ec0-0a54-4698-8386-d59ef15ca0cc could not be found. Jun 01 04:27:29.548502 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:29.548502 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:27:29.548502 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:29.548502 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:29.548502 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:27:29.548502 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:27:29.548502 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:27:29.548502 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:27:29.548502 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c4ba8ec0-0a54-4698-8386-d59ef15ca0cc could not be found. Jun 01 04:27:29.548502 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:29.548502 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-b36b120e-c822-4a46-bafc-5d1368ad2d62 tempest-VolumesNegativeTest-774364669 tempest-VolumesNegativeTest-774364669-project] Returning 404 to user: Volume c4ba8ec0-0a54-4698-8386-d59ef15ca0cc could not be found. {{(pid=118517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:27:29.548502 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-b36b120e-c822-4a46-bafc-5d1368ad2d62 tempest-VolumesNegativeTest-774364669 tempest-VolumesNegativeTest-774364669-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c4ba8ec0-0a54-4698-8386-d59ef15ca0cc" status: 404 len: 109 microversion: 2.1 time: 0.328527 Jun 01 04:27:29.548502 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 8/8] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 1 04:27:29 2022] GET /compute/v2.1/os-volumes/c4ba8ec0-0a54-4698-8386-d59ef15ca0cc => generated 109 bytes in 338 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:27:30.464945 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-8f9de3f3-bbc9-4846-b0eb-da9967b92ff0 tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 4.036923 Jun 01 04:27:30.467005 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 1/9] 10.222.0.18 () {60 vars in 1154 bytes} [Wed Jun 1 04:27:26 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 4042 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 01 04:27:30.479738 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-859377f4-28e4-42ac-99ab-87ff778f02e5 tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] Calling method '.version_select at 0x7ff3276af940>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:30.636555 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-859377f4-28e4-42ac-99ab-87ff778f02e5 tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/034572c4-9326-47b7-9001-8198bd38adba" status: 200 len: 343 microversion: 2.1 time: 0.161886 Jun 01 04:27:30.637932 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 9/10] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 1 04:27:30 2022] GET /compute/v2.1/os-volumes/034572c4-9326-47b7-9001-8198bd38adba => generated 343 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:27:30.707069 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-91b617a4-178a-4776-9bba-ec5704f10cca tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2035448634", "imageRef": "14321baa-3ac5-4c53-8054-4945abce5b2d", "flavorRef": "452", "networks": [{"uuid": "13e7f666-dfbf-45d5-abef-3761ea497503"}]}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:27:30.833233 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.network.neutron [None req-91b617a4-178a-4776-9bba-ec5704f10cca tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] validate_networks() for [('13e7f666-dfbf-45d5-abef-3761ea497503', None, None, None, None, None)] {{(pid=118516) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 01 04:27:31.650411 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-23312bbe-0463-484c-a85e-646c78a3746e tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] Calling method '.version_select at 0x7ff3276c5280>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:31.773840 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-23312bbe-0463-484c-a85e-646c78a3746e tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/034572c4-9326-47b7-9001-8198bd38adba" status: 200 len: 343 microversion: 2.1 time: 0.127585 Jun 01 04:27:31.775693 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 10/11] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 1 04:27:31 2022] GET /compute/v2.1/os-volumes/034572c4-9326-47b7-9001-8198bd38adba => generated 343 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:27:32.755468 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-91b617a4-178a-4776-9bba-ec5704f10cca tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Flavor limits 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 01 04:27:32.755983 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-91b617a4-178a-4776-9bba-ec5704f10cca tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Image limits 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 01 04:27:32.761662 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-91b617a4-178a-4776-9bba-ec5704f10cca tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Flavor pref 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 01 04:27:32.761662 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-91b617a4-178a-4776-9bba-ec5704f10cca tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Image pref 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 01 04:27:32.761662 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-91b617a4-178a-4776-9bba-ec5704f10cca tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 01 04:27:32.774544 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-91b617a4-178a-4776-9bba-ec5704f10cca tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:32.775094 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-91b617a4-178a-4776-9bba-ec5704f10cca tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:32.775975 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-91b617a4-178a-4776-9bba-ec5704f10cca tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:32.776628 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-91b617a4-178a-4776-9bba-ec5704f10cca tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:32.788244 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-2727a0b6-126d-47c2-ab2b-f1a387d68a6e tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] Calling method '.version_select at 0x7ff3276c5940>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:32.818440 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-91b617a4-178a-4776-9bba-ec5704f10cca tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Getting quotas for project 8eb15379902c4745a1e3fd5b83d0e4be. Resources: {'ram', 'instances', 'cores'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:27:32.827159 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-91b617a4-178a-4776-9bba-ec5704f10cca tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Getting quotas for user c2eb70d1582b4876931f05cd4015a346 and project 8eb15379902c4745a1e3fd5b83d0e4be. Resources: {'ram', 'instances', 'cores'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:27:32.848323 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-91b617a4-178a-4776-9bba-ec5704f10cca tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Going to run 1 instances... {{(pid=118516) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 01 04:27:32.853337 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-91b617a4-178a-4776-9bba-ec5704f10cca tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14321baa-3ac5-4c53-8054-4945abce5b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 01 04:27:32.906356 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-2727a0b6-126d-47c2-ab2b-f1a387d68a6e tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/034572c4-9326-47b7-9001-8198bd38adba" status: 200 len: 344 microversion: 2.1 time: 0.121774 Jun 01 04:27:32.906920 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 11/12] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 1 04:27:32 2022] GET /compute/v2.1/os-volumes/034572c4-9326-47b7-9001-8198bd38adba => generated 344 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:27:32.921330 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-08d32d02-e417-464d-a517-5f9dc4f80b14 tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] Action: 'create', calling method: .version_select at 0x7ff3276c5f70>, body: {"snapshot": {"volume_id": "034572c4-9326-47b7-9001-8198bd38adba", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-609517841"}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:27:33.072883 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-91b617a4-178a-4776-9bba-ec5704f10cca tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.581940 Jun 01 04:27:33.074115 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 2/13] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 1 04:27:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 01 04:27:33.085529 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-955a847d-f1ac-4fab-af35-a36c466c3685 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:33.086506 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-955a847d-f1ac-4fab-af35-a36c466c3685 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:33.305714 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-955a847d-f1ac-4fab-af35-a36c466c3685 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:33.349692 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-955a847d-f1ac-4fab-af35-a36c466c3685 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1215 microversion: 2.1 time: 0.268413 Jun 01 04:27:33.380642 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 3/14] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:33 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1215 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:27:33.748066 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-08d32d02-e417-464d-a517-5f9dc4f80b14 tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.831083 Jun 01 04:27:33.753297 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 12/15] 10.222.0.18 () {60 vars in 1161 bytes} [Wed Jun 1 04:27:32 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:27:33.758638 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-334ca539-6285-46da-8a9a-a4598479ac13 tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] Calling method '.version_select at 0x7ff326e43ee0>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:33.823680 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-334ca539-6285-46da-8a9a-a4598479ac13 tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/a799ed87-adac-4f9e-ae84-db3dc5ad05be" status: 200 len: 286 microversion: 2.1 time: 0.068884 Jun 01 04:27:33.824586 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 4/16] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jun 1 04:27:33 2022] GET /compute/v2.1/os-snapshots/a799ed87-adac-4f9e-ae84-db3dc5ad05be => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:27:33.834269 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-b4ba8048-d99f-4bf6-8b92-9f2f7ec554d4 tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] Calling method '.version_select at 0x7ff3276c5820>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:33.927387 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-b4ba8048-d99f-4bf6-8b92-9f2f7ec554d4 tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.096867 Jun 01 04:27:33.928125 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 13/17] 10.222.0.18 () {58 vars in 1139 bytes} [Wed Jun 1 04:27:33 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:27:33.939723 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-01b690f2-4cbd-4aaa-8383-501cd7543461 tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] Calling method '.version_select at 0x7ff3265ec820>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:34.011881 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-01b690f2-4cbd-4aaa-8383-501cd7543461 tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/a799ed87-adac-4f9e-ae84-db3dc5ad05be" status: 200 len: 286 microversion: 2.1 time: 0.076281 Jun 01 04:27:34.012899 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 5/18] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jun 1 04:27:33 2022] GET /compute/v2.1/os-snapshots/a799ed87-adac-4f9e-ae84-db3dc5ad05be => generated 286 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:27:34.385884 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-135f7520-6e43-4d1d-9170-6384f5eccf73 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:34.387862 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-135f7520-6e43-4d1d-9170-6384f5eccf73 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:34.667913 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-135f7520-6e43-4d1d-9170-6384f5eccf73 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:34.691242 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-135f7520-6e43-4d1d-9170-6384f5eccf73 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1215 microversion: 2.1 time: 0.309816 Jun 01 04:27:34.705437 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 14/19] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:34 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1215 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:27:35.024124 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-e236e19f-4345-47b1-a3ca-fd9d201f0fbe tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] Calling method '.version_select at 0x7ff3265ecee0>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:35.163399 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-e236e19f-4345-47b1-a3ca-fd9d201f0fbe tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/a799ed87-adac-4f9e-ae84-db3dc5ad05be" status: 200 len: 286 microversion: 2.1 time: 0.143116 Jun 01 04:27:35.168173 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 6/20] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jun 1 04:27:35 2022] GET /compute/v2.1/os-snapshots/a799ed87-adac-4f9e-ae84-db3dc5ad05be => generated 286 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:27:35.717294 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-8479d211-238d-4947-a4f3-3fe607f2575f tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:35.717294 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-8479d211-238d-4947-a4f3-3fe607f2575f tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:36.043792 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-8479d211-238d-4947-a4f3-3fe607f2575f tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:36.054122 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-8479d211-238d-4947-a4f3-3fe607f2575f tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1215 microversion: 2.1 time: 0.345345 Jun 01 04:27:36.054618 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 15/21] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:35 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1215 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:27:36.175548 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-f64326a0-384f-48eb-8ece-d4963c7895e9 tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] Calling method '.version_select at 0x7ff3265ecd30>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:36.227908 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-f64326a0-384f-48eb-8ece-d4963c7895e9 tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/a799ed87-adac-4f9e-ae84-db3dc5ad05be" status: 200 len: 286 microversion: 2.1 time: 0.056589 Jun 01 04:27:36.228784 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 7/22] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jun 1 04:27:36 2022] GET /compute/v2.1/os-snapshots/a799ed87-adac-4f9e-ae84-db3dc5ad05be => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:27:37.080299 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-b04ad58b-390e-4268-a5c0-095b21d34eae tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:37.081654 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-b04ad58b-390e-4268-a5c0-095b21d34eae tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:37.100071 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b04ad58b-390e-4268-a5c0-095b21d34eae tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:37.103125 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b04ad58b-390e-4268-a5c0-095b21d34eae tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:37.109649 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b04ad58b-390e-4268-a5c0-095b21d34eae tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:37.111142 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b04ad58b-390e-4268-a5c0-095b21d34eae tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:37.250295 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-ff1095b1-374a-432b-a7f5-f11ba1df51fa tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] Calling method '.version_select at 0x7ff3265ec5e0>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:37.339729 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-ff1095b1-374a-432b-a7f5-f11ba1df51fa tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/a799ed87-adac-4f9e-ae84-db3dc5ad05be" status: 200 len: 286 microversion: 2.1 time: 0.101450 Jun 01 04:27:37.342108 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 8/23] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jun 1 04:27:37 2022] GET /compute/v2.1/os-snapshots/a799ed87-adac-4f9e-ae84-db3dc5ad05be => generated 286 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:27:37.740092 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-b04ad58b-390e-4268-a5c0-095b21d34eae tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:37.779046 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-b04ad58b-390e-4268-a5c0-095b21d34eae tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1219 microversion: 2.1 time: 0.710331 Jun 01 04:27:37.782789 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 16/24] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:37 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1219 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:27:38.358275 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-597b1916-35b1-4322-9f87-99e9785ef93c tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] Calling method '.version_select at 0x7ff327601430>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:38.396747 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-597b1916-35b1-4322-9f87-99e9785ef93c tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/a799ed87-adac-4f9e-ae84-db3dc5ad05be" status: 200 len: 286 microversion: 2.1 time: 0.042472 Jun 01 04:27:38.397314 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 17/25] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jun 1 04:27:38 2022] GET /compute/v2.1/os-snapshots/a799ed87-adac-4f9e-ae84-db3dc5ad05be => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:27:38.488335 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-c4b89db2-5f0a-4608-ba33-6db416ffa370 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Action: 'create', calling method: .version_select at 0x7ff326e43e50>, body: {"keypair": {"name": "tempest-keypair-1989291720", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcrIf+RSpjs+sAqYDKeSZ2vRPdAB5PBeekCrCmJqGikn6GDyHStB2R4+YLUJCj1iAhjungYtpHZjru/8nh1SYBTR2FP9gE2x3M0rbshyb4Gtx5MsHfq9X0B/rT7aXkX1Q=="}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:27:38.537412 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-c4b89db2-5f0a-4608-ba33-6db416ffa370 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Getting quotas for project d12a9b5dc38b4aa7aed77adc89d0e6a4. Resources: {'key_pairs'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:27:38.542064 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-c4b89db2-5f0a-4608-ba33-6db416ffa370 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Getting quotas for user 85df2f6595d3489bb5d1d547cb2cd900 and project d12a9b5dc38b4aa7aed77adc89d0e6a4. Resources: {'key_pairs'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:27:38.670881 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-c4b89db2-5f0a-4608-ba33-6db416ffa370 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.628156 Jun 01 04:27:38.681036 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 9/26] 10.222.0.18 () {62 vars in 1199 bytes} [Wed Jun 1 04:27:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 639 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 01 04:27:38.808214 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-f67a9178-0f67-46c9-ac1b-6f5175b263ce tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-836037532", "imageRef": "14321baa-3ac5-4c53-8054-4945abce5b2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:27:38.812760 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d25a51b7-0ce8-4347-9d02-f00d73232505 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:38.813445 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-d25a51b7-0ce8-4347-9d02-f00d73232505 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:38.827373 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d25a51b7-0ce8-4347-9d02-f00d73232505 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:38.834172 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d25a51b7-0ce8-4347-9d02-f00d73232505 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:38.839831 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d25a51b7-0ce8-4347-9d02-f00d73232505 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:38.840793 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d25a51b7-0ce8-4347-9d02-f00d73232505 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:39.020026 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.network.neutron [None req-f67a9178-0f67-46c9-ac1b-6f5175b263ce tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] validate_networks() for [('df968078-6547-44fa-a4b9-d4e6c486e9a4', None, None, None, None, None)] {{(pid=118517) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 01 04:27:39.062764 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-d25a51b7-0ce8-4347-9d02-f00d73232505 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:39.087700 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-d25a51b7-0ce8-4347-9d02-f00d73232505 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1219 microversion: 2.1 time: 0.283161 Jun 01 04:27:39.088950 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 10/27] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:38 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1219 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:27:39.407784 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-4cf56cba-b724-4f51-86ab-21db7673b2c2 tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] Calling method '.version_select at 0x7ff326e2daf0>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:39.466020 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-4cf56cba-b724-4f51-86ab-21db7673b2c2 tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/a799ed87-adac-4f9e-ae84-db3dc5ad05be" status: 200 len: 286 microversion: 2.1 time: 0.062074 Jun 01 04:27:39.470140 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 11/28] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jun 1 04:27:39 2022] GET /compute/v2.1/os-snapshots/a799ed87-adac-4f9e-ae84-db3dc5ad05be => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:27:40.104756 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-21c078e9-1943-47d9-a951-ff0a48fc4018 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:40.105417 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-21c078e9-1943-47d9-a951-ff0a48fc4018 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:40.114714 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-21c078e9-1943-47d9-a951-ff0a48fc4018 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:40.115178 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-21c078e9-1943-47d9-a951-ff0a48fc4018 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:40.115992 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-21c078e9-1943-47d9-a951-ff0a48fc4018 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:40.116441 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-21c078e9-1943-47d9-a951-ff0a48fc4018 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:40.291909 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-21c078e9-1943-47d9-a951-ff0a48fc4018 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:40.303962 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-21c078e9-1943-47d9-a951-ff0a48fc4018 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1211 microversion: 2.1 time: 0.203091 Jun 01 04:27:40.304556 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 12/29] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:40 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1211 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:27:40.478148 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-f2e357ca-fc8e-4d4f-a43a-6af9397e1685 tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] Calling method '.version_select at 0x7ff325d948b0>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:40.658702 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-f67a9178-0f67-46c9-ac1b-6f5175b263ce tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Flavor limits 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 01 04:27:40.662949 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-f67a9178-0f67-46c9-ac1b-6f5175b263ce tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Image limits 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 01 04:27:40.662949 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-f67a9178-0f67-46c9-ac1b-6f5175b263ce tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Flavor pref 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 01 04:27:40.662949 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-f67a9178-0f67-46c9-ac1b-6f5175b263ce tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Image pref 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 01 04:27:40.662949 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-f67a9178-0f67-46c9-ac1b-6f5175b263ce tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 01 04:27:40.692606 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f67a9178-0f67-46c9-ac1b-6f5175b263ce tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:40.693995 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f67a9178-0f67-46c9-ac1b-6f5175b263ce tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:40.697505 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f67a9178-0f67-46c9-ac1b-6f5175b263ce tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:40.698966 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f67a9178-0f67-46c9-ac1b-6f5175b263ce tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:40.774146 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.quota [None req-f67a9178-0f67-46c9-ac1b-6f5175b263ce tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Getting quotas for project bda53dca70e54e208b2767a833923234. Resources: {'ram', 'instances', 'cores'} {{(pid=118517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:27:40.785328 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.quota [None req-f67a9178-0f67-46c9-ac1b-6f5175b263ce tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Getting quotas for user 12816eca659542af9e41b92fdb674eab and project bda53dca70e54e208b2767a833923234. Resources: {'ram', 'instances', 'cores'} {{(pid=118517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:27:40.824247 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-f67a9178-0f67-46c9-ac1b-6f5175b263ce tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Going to run 1 instances... {{(pid=118517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 01 04:27:40.829399 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-f67a9178-0f67-46c9-ac1b-6f5175b263ce tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14321baa-3ac5-4c53-8054-4945abce5b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 01 04:27:41.140955 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-f67a9178-0f67-46c9-ac1b-6f5175b263ce tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.619179 Jun 01 04:27:41.142230 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 18/30] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 1 04:27:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 2622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 01 04:27:41.153439 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-9bcb6c7c-ecc6-49cc-b535-bbf86a867498 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:41.162245 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-9bcb6c7c-ecc6-49cc-b535-bbf86a867498 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:41.361588 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-9bcb6c7c-ecc6-49cc-b535-bbf86a867498 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:41.398454 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-9bcb6c7c-ecc6-49cc-b535-bbf86a867498 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1221 microversion: 2.1 time: 0.249631 Jun 01 04:27:41.399058 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 19/31] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:41 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1221 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:27:41.409742 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-f2e357ca-fc8e-4d4f-a43a-6af9397e1685 tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/a799ed87-adac-4f9e-ae84-db3dc5ad05be" status: 200 len: 287 microversion: 2.1 time: 0.933001 Jun 01 04:27:41.417413 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 13/32] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jun 1 04:27:40 2022] GET /compute/v2.1/os-snapshots/a799ed87-adac-4f9e-ae84-db3dc5ad05be => generated 287 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:27:41.423252 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-709349f3-6d93-43d0-9edd-50176e521a1b tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:41.424392 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-709349f3-6d93-43d0-9edd-50176e521a1b tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:41.444745 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-0ba7581b-cc86-4e69-a4af-8fc82fbaa16d tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] Calling method '.version_select at 0x7ff326cfff70>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:41.446803 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-709349f3-6d93-43d0-9edd-50176e521a1b tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:41.447296 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-709349f3-6d93-43d0-9edd-50176e521a1b tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:41.448121 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-709349f3-6d93-43d0-9edd-50176e521a1b tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:41.449699 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-709349f3-6d93-43d0-9edd-50176e521a1b tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:41.651233 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-709349f3-6d93-43d0-9edd-50176e521a1b tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:41.659963 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-709349f3-6d93-43d0-9edd-50176e521a1b tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1275 microversion: 2.1 time: 0.245634 Jun 01 04:27:41.666554 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 14/33] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:41 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1275 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:27:41.801578 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-055585dc-c680-4aad-a75e-b32b3cb3826b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1668479921", "imageRef": "14321baa-3ac5-4c53-8054-4945abce5b2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:27:41.984586 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-0ba7581b-cc86-4e69-a4af-8fc82fbaa16d tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/a799ed87-adac-4f9e-ae84-db3dc5ad05be" status: 202 len: 0 microversion: 2.1 time: 0.552584 Jun 01 04:27:41.985901 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 20/34] 10.222.0.18 () {58 vars in 1253 bytes} [Wed Jun 1 04:27:41 2022] DELETE /compute/v2.1/os-snapshots/a799ed87-adac-4f9e-ae84-db3dc5ad05be => generated 0 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 01 04:27:41.997055 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-61806f95-a053-4d4e-b6ed-a54e8a279c58 tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] Calling method '.version_select at 0x7ff326d10b80>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:42.034903 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.network.neutron [None req-055585dc-c680-4aad-a75e-b32b3cb3826b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] validate_networks() for [('df968078-6547-44fa-a4b9-d4e6c486e9a4', None, None, None, None, None)] {{(pid=118516) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 01 04:27:42.191187 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-61806f95-a053-4d4e-b6ed-a54e8a279c58 tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/a799ed87-adac-4f9e-ae84-db3dc5ad05be" status: 200 len: 286 microversion: 2.1 time: 0.200883 Jun 01 04:27:42.192328 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 21/35] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jun 1 04:27:41 2022] GET /compute/v2.1/os-snapshots/a799ed87-adac-4f9e-ae84-db3dc5ad05be => generated 286 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:27:42.683013 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-73a822fa-8513-48c6-987e-3ad4113d5dd7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:42.684385 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-73a822fa-8513-48c6-987e-3ad4113d5dd7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:42.694900 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-73a822fa-8513-48c6-987e-3ad4113d5dd7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:42.695326 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-73a822fa-8513-48c6-987e-3ad4113d5dd7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:42.706688 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-73a822fa-8513-48c6-987e-3ad4113d5dd7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:42.706931 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-73a822fa-8513-48c6-987e-3ad4113d5dd7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:42.795083 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell0:SELECT=2 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:42.889941 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-73a822fa-8513-48c6-987e-3ad4113d5dd7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:42.903043 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-73a822fa-8513-48c6-987e-3ad4113d5dd7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1273 microversion: 2.1 time: 0.224139 Jun 01 04:27:42.903666 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 22/36] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:42 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1273 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:27:43.208237 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a7a2413c-2716-4814-a555-5b7ffbacd281 tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] Calling method '.version_select at 0x7ff3264acaf0>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:43.336110 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.wsgi [None req-a7a2413c-2716-4814-a555-5b7ffbacd281 tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] HTTP exception thrown: Snapshot a799ed87-adac-4f9e-ae84-db3dc5ad05be could not be found. Jun 01 04:27:43.340986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a7a2413c-2716-4814-a555-5b7ffbacd281 tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] Request method failure captured: Jun 01 04:27:43.340986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: request: GET /compute/v2.1/os-snapshots/a799ed87-adac-4f9e-ae84-db3dc5ad05be HTTP/1.1 Jun 01 04:27:43.340986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept: application/json Jun 01 04:27:43.340986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept-Encoding: identity Jun 01 04:27:43.340986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Connection: close Jun 01 04:27:43.340986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Length: 0 Jun 01 04:27:43.340986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Type: application/json Jun 01 04:27:43.340986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Host: 10.222.0.18 Jun 01 04:27:43.340986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Openstack-System-Scope: None Jun 01 04:27:43.340986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: User-Agent: python-urllib3/1.26.9 Jun 01 04:27:43.340986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Auth-Token: gAAAAABiluqugsXXNwtlZC7hWJYCIxE4JBgmtpQLqkXtV06Msviuf8n64X127uO8oSbKvorc947AopVkKN93WOeYHkwDrVWrZIG8Fi2yWHjaNq1I2UplQu4RX-vxlnf3JYlH_SE3D_epXwHIFeDF2KrLDxxweKD5ARfM0DrHrUOQ2cpwWrdxELM Jun 01 04:27:43.340986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Id: None Jun 01 04:27:43.340986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Name: None Jun 01 04:27:43.340986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Identity-Status: Confirmed Jun 01 04:27:43.340986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Is-Admin-Project: True Jun 01 04:27:43.340986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Id: default Jun 01 04:27:43.340986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Name: Default Jun 01 04:27:43.340986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Id: 7a45f5b11ffc4a99b4d7d7b8fbf86838 Jun 01 04:27:43.340986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-485319763 Jun 01 04:27:43.340986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Role: reader,member Jun 01 04:27:43.340986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Roles: reader,member Jun 01 04:27:43.342092 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7a45f5b11ffc4a99b4d7d7b8fbf86838"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7a45f5b11ffc4a99b4d7d7b8fbf86838"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7a45f5b11ffc4a99b4d7d7b8fbf86838"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7a45f5b11ffc4a99b4d7d7b8fbf86838"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:27:43.342092 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant: tempest-VolumesSnapshotsTestJSON-485319763 Jun 01 04:27:43.342092 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Id: 7a45f5b11ffc4a99b4d7d7b8fbf86838 Jun 01 04:27:43.342092 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-485319763 Jun 01 04:27:43.342092 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User: tempest-VolumesSnapshotsTestJSON-485319763-project Jun 01 04:27:43.342092 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Id: default Jun 01 04:27:43.342092 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Name: Default Jun 01 04:27:43.342092 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Id: 4801021c8f4741d9952c5db2f0e22f1a Jun 01 04:27:43.342092 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Name: tempest-VolumesSnapshotsTestJSON-485319763-project Jun 01 04:27:43.342092 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: method: Jun 01 04:27:43.342092 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: exception: Snapshot a799ed87-adac-4f9e-ae84-db3dc5ad05be could not be found. Jun 01 04:27:43.342092 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: action_args: {'id': 'a799ed87-adac-4f9e-ae84-db3dc5ad05be'} Jun 01 04:27:43.342092 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:27:43.342745 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:43.342745 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 01 04:27:43.342745 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 01 04:27:43.342745 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 01 04:27:43.342745 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 01 04:27:43.342745 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 01 04:27:43.342745 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 01 04:27:43.342745 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 01 04:27:43.342745 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 01 04:27:43.342745 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 01 04:27:43.342745 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 01 04:27:43.342745 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 01 04:27:43.342745 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 01 04:27:43.342745 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 01 04:27:43.342745 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 01 04:27:43.342745 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a799ed87-adac-4f9e-ae84-db3dc5ad05be could not be found. (HTTP 404) (Request-ID: req-bd9b2c20-6b04-4a46-99c2-ca9763aaec9e) Jun 01 04:27:43.342745 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:43.342745 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:27:43.343628 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:43.343628 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:43.343628 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 01 04:27:43.343628 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 01 04:27:43.343628 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 01 04:27:43.343628 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 01 04:27:43.343628 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 01 04:27:43.343628 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 01 04:27:43.343628 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 01 04:27:43.343628 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 01 04:27:43.343628 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 01 04:27:43.343628 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 01 04:27:43.343628 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 01 04:27:43.343628 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 01 04:27:43.343628 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 01 04:27:43.343628 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 01 04:27:43.343628 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 01 04:27:43.343628 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 01 04:27:43.343628 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 01 04:27:43.345031 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 01 04:27:43.345031 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 01 04:27:43.345031 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 01 04:27:43.345031 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 01 04:27:43.345031 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 01 04:27:43.345031 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a799ed87-adac-4f9e-ae84-db3dc5ad05be could not be found. Jun 01 04:27:43.345031 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:43.345031 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:27:43.345031 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:43.345031 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:43.345031 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:27:43.345031 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:27:43.345031 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:27:43.345031 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:27:43.345031 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 01 04:27:43.345031 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 01 04:27:43.345031 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:27:43.345031 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:27:43.345031 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 01 04:27:43.345031 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:27:43.352976 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a799ed87-adac-4f9e-ae84-db3dc5ad05be could not be found. Jun 01 04:27:43.352976 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:43.352976 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:27:43.352976 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:43.352976 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:43.352976 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:27:43.352976 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:27:43.352976 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:27:43.352976 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:27:43.352976 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a799ed87-adac-4f9e-ae84-db3dc5ad05be could not be found. Jun 01 04:27:43.352976 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:27:43.352976 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a7a2413c-2716-4814-a555-5b7ffbacd281 tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] Returning 404 to user: Snapshot a799ed87-adac-4f9e-ae84-db3dc5ad05be could not be found. {{(pid=118517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:27:43.352976 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-a7a2413c-2716-4814-a555-5b7ffbacd281 tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/a799ed87-adac-4f9e-ae84-db3dc5ad05be" status: 404 len: 111 microversion: 2.1 time: 0.143106 Jun 01 04:27:43.352976 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 23/37] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jun 1 04:27:43 2022] GET /compute/v2.1/os-snapshots/a799ed87-adac-4f9e-ae84-db3dc5ad05be => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 01 04:27:43.366095 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-abd6f903-b7d6-4631-88c7-b6d076b2ce51 tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] Calling method '.version_select at 0x7ff3276c5a60>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:43.711352 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-abd6f903-b7d6-4631-88c7-b6d076b2ce51 tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/034572c4-9326-47b7-9001-8198bd38adba" status: 202 len: 0 microversion: 2.1 time: 0.360402 Jun 01 04:27:43.714589 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 24/38] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jun 1 04:27:43 2022] DELETE /compute/v2.1/os-volumes/034572c4-9326-47b7-9001-8198bd38adba => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 01 04:27:43.722674 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-091afccf-8274-422e-8f8c-302b90677156 tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] Calling method '.version_select at 0x7ff3264aca60>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:43.830958 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-091afccf-8274-422e-8f8c-302b90677156 tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/034572c4-9326-47b7-9001-8198bd38adba" status: 200 len: 343 microversion: 2.1 time: 0.114406 Jun 01 04:27:43.831819 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 25/39] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 1 04:27:43 2022] GET /compute/v2.1/os-volumes/034572c4-9326-47b7-9001-8198bd38adba => generated 343 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:27:43.906349 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-055585dc-c680-4aad-a75e-b32b3cb3826b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Flavor limits 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 01 04:27:43.908618 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-055585dc-c680-4aad-a75e-b32b3cb3826b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Image limits 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 01 04:27:43.908618 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-055585dc-c680-4aad-a75e-b32b3cb3826b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Flavor pref 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 01 04:27:43.908618 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-055585dc-c680-4aad-a75e-b32b3cb3826b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Image pref 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 01 04:27:43.908618 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-055585dc-c680-4aad-a75e-b32b3cb3826b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 01 04:27:43.922822 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-35b52ea4-e3ca-4a9c-8cbd-4c5ff64c95ed tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:43.923628 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-35b52ea4-e3ca-4a9c-8cbd-4c5ff64c95ed tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:43.932463 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-35b52ea4-e3ca-4a9c-8cbd-4c5ff64c95ed tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:43.933042 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-055585dc-c680-4aad-a75e-b32b3cb3826b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:43.935885 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-055585dc-c680-4aad-a75e-b32b3cb3826b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:43.941036 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-35b52ea4-e3ca-4a9c-8cbd-4c5ff64c95ed tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:43.942271 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-35b52ea4-e3ca-4a9c-8cbd-4c5ff64c95ed tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:43.943202 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-35b52ea4-e3ca-4a9c-8cbd-4c5ff64c95ed tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:43.961510 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-055585dc-c680-4aad-a75e-b32b3cb3826b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:43.968498 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-055585dc-c680-4aad-a75e-b32b3cb3826b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:44.015993 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-055585dc-c680-4aad-a75e-b32b3cb3826b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Getting quotas for project bda53dca70e54e208b2767a833923234. Resources: {'ram', 'instances', 'cores'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:27:44.023847 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-055585dc-c680-4aad-a75e-b32b3cb3826b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Getting quotas for user 12816eca659542af9e41b92fdb674eab and project bda53dca70e54e208b2767a833923234. Resources: {'ram', 'instances', 'cores'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:27:44.067251 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-055585dc-c680-4aad-a75e-b32b3cb3826b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Going to run 1 instances... {{(pid=118516) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 01 04:27:44.072277 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-055585dc-c680-4aad-a75e-b32b3cb3826b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14321baa-3ac5-4c53-8054-4945abce5b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 01 04:27:44.332595 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-055585dc-c680-4aad-a75e-b32b3cb3826b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.546226 Jun 01 04:27:44.333376 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 15/40] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 1 04:27:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 2553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 01 04:27:44.381201 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-5ee3cdb4-f964-44bd-9924-9a6631c8337f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:44.509622 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-5ee3cdb4-f964-44bd-9924-9a6631c8337f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:44.690864 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-5ee3cdb4-f964-44bd-9924-9a6631c8337f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:44.690864 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-5ee3cdb4-f964-44bd-9924-9a6631c8337f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1222 microversion: 2.1 time: 0.218947 Jun 01 04:27:44.690864 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 16/41] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:44 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1222 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:27:44.694350 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-35b52ea4-e3ca-4a9c-8cbd-4c5ff64c95ed tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:44.694350 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-35b52ea4-e3ca-4a9c-8cbd-4c5ff64c95ed tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.723294 Jun 01 04:27:44.694350 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 26/42] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:43 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:27:44.844991 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-145e35b2-80a8-4620-b142-0ac45f099f5b tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] Calling method '.version_select at 0x7ff325d87ee0>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:45.328155 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-ece8cb34-3639-464b-a8be-384df70271ac tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1897090020", "imageRef": "14321baa-3ac5-4c53-8054-4945abce5b2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0672bd5d-634b-4f48-aa77-f628be2afa15"}], "security_groups": [{"name": "tempest-securitygroup--1985049810"}], "key_name": "tempest-keypair-1989291720", "user_data": "}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:27:45.538607 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.wsgi [None req-145e35b2-80a8-4620-b142-0ac45f099f5b tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] HTTP exception thrown: Volume 034572c4-9326-47b7-9001-8198bd38adba could not be found. Jun 01 04:27:45.552863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-145e35b2-80a8-4620-b142-0ac45f099f5b tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] Request method failure captured: Jun 01 04:27:45.552863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: request: GET /compute/v2.1/os-volumes/034572c4-9326-47b7-9001-8198bd38adba HTTP/1.1 Jun 01 04:27:45.552863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept: application/json Jun 01 04:27:45.552863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept-Encoding: identity Jun 01 04:27:45.552863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Connection: close Jun 01 04:27:45.552863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Length: 0 Jun 01 04:27:45.552863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Type: application/json Jun 01 04:27:45.552863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Host: 10.222.0.18 Jun 01 04:27:45.552863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Openstack-System-Scope: None Jun 01 04:27:45.552863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: User-Agent: python-urllib3/1.26.9 Jun 01 04:27:45.552863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Auth-Token: gAAAAABiluqugsXXNwtlZC7hWJYCIxE4JBgmtpQLqkXtV06Msviuf8n64X127uO8oSbKvorc947AopVkKN93WOeYHkwDrVWrZIG8Fi2yWHjaNq1I2UplQu4RX-vxlnf3JYlH_SE3D_epXwHIFeDF2KrLDxxweKD5ARfM0DrHrUOQ2cpwWrdxELM Jun 01 04:27:45.552863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Id: None Jun 01 04:27:45.552863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Name: None Jun 01 04:27:45.552863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Identity-Status: Confirmed Jun 01 04:27:45.552863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Is-Admin-Project: True Jun 01 04:27:45.552863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Id: default Jun 01 04:27:45.552863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Name: Default Jun 01 04:27:45.552863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Id: 7a45f5b11ffc4a99b4d7d7b8fbf86838 Jun 01 04:27:45.552863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-485319763 Jun 01 04:27:45.552863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Role: reader,member Jun 01 04:27:45.552863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Roles: reader,member Jun 01 04:27:45.554264 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7a45f5b11ffc4a99b4d7d7b8fbf86838"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7a45f5b11ffc4a99b4d7d7b8fbf86838"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7a45f5b11ffc4a99b4d7d7b8fbf86838"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7a45f5b11ffc4a99b4d7d7b8fbf86838"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:27:45.554264 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant: tempest-VolumesSnapshotsTestJSON-485319763 Jun 01 04:27:45.554264 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Id: 7a45f5b11ffc4a99b4d7d7b8fbf86838 Jun 01 04:27:45.554264 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-485319763 Jun 01 04:27:45.554264 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User: tempest-VolumesSnapshotsTestJSON-485319763-project Jun 01 04:27:45.554264 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Id: default Jun 01 04:27:45.554264 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Name: Default Jun 01 04:27:45.554264 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Id: 4801021c8f4741d9952c5db2f0e22f1a Jun 01 04:27:45.554264 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Name: tempest-VolumesSnapshotsTestJSON-485319763-project Jun 01 04:27:45.554264 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: method: Jun 01 04:27:45.554264 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: exception: Volume 034572c4-9326-47b7-9001-8198bd38adba could not be found. Jun 01 04:27:45.554264 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: action_args: {'id': '034572c4-9326-47b7-9001-8198bd38adba'} Jun 01 04:27:45.554264 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:27:45.555132 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:45.555132 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 01 04:27:45.555132 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 01 04:27:45.555132 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 01 04:27:45.555132 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 01 04:27:45.555132 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 01 04:27:45.555132 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 01 04:27:45.555132 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 01 04:27:45.555132 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 01 04:27:45.555132 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 01 04:27:45.555132 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 01 04:27:45.555132 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 01 04:27:45.555132 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 01 04:27:45.555132 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 01 04:27:45.555132 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 01 04:27:45.555132 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 034572c4-9326-47b7-9001-8198bd38adba could not be found. (HTTP 404) (Request-ID: req-eb3c75d1-10cc-4b1e-8c38-54c453de21af) Jun 01 04:27:45.555132 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:27:45.555132 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:27:45.555132 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:27:45.556327 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:45.556327 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 01 04:27:45.556327 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 01 04:27:45.556327 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 01 04:27:45.556327 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 01 04:27:45.556327 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 01 04:27:45.556327 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 01 04:27:45.556327 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 01 04:27:45.556327 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 01 04:27:45.556327 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 01 04:27:45.556327 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 01 04:27:45.556327 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 01 04:27:45.556327 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 01 04:27:45.556327 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 01 04:27:45.556327 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 01 04:27:45.556327 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 01 04:27:45.556327 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 01 04:27:45.556327 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 01 04:27:45.556327 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 01 04:27:45.557353 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 01 04:27:45.557353 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 01 04:27:45.557353 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 01 04:27:45.557353 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 01 04:27:45.557353 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 034572c4-9326-47b7-9001-8198bd38adba could not be found. Jun 01 04:27:45.557353 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:27:45.557353 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:27:45.557353 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:27:45.557353 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:45.557353 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:27:45.557353 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:27:45.557353 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:27:45.557353 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:27:45.557353 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 01 04:27:45.557353 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 01 04:27:45.557353 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:27:45.557353 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:27:45.557353 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 01 04:27:45.557353 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:27:45.559131 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 034572c4-9326-47b7-9001-8198bd38adba could not be found. Jun 01 04:27:45.559131 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:27:45.559131 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:27:45.559131 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:27:45.559131 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:45.559131 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:27:45.559131 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:27:45.559131 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:27:45.559131 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:27:45.559131 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 034572c4-9326-47b7-9001-8198bd38adba could not be found. Jun 01 04:27:45.559131 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:27:45.559131 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-145e35b2-80a8-4620-b142-0ac45f099f5b tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] Returning 404 to user: Volume 034572c4-9326-47b7-9001-8198bd38adba could not be found. {{(pid=118516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:27:45.559131 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-145e35b2-80a8-4620-b142-0ac45f099f5b tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/034572c4-9326-47b7-9001-8198bd38adba" status: 404 len: 109 microversion: 2.1 time: 0.707181 Jun 01 04:27:45.559131 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 17/43] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 1 04:27:44 2022] GET /compute/v2.1/os-volumes/034572c4-9326-47b7-9001-8198bd38adba => generated 109 bytes in 709 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:27:45.573266 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-0c66f611-62e6-4aed-8d4e-78f9cbc5b91d tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] Calling method '.version_select at 0x7ff325d87dc0>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:45.645280 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.network.neutron [None req-ece8cb34-3639-464b-a8be-384df70271ac tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] validate_networks() for [('0672bd5d-634b-4f48-aa77-f628be2afa15', None, None, None, None, None)] {{(pid=118517) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 01 04:27:45.731464 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.wsgi [None req-0c66f611-62e6-4aed-8d4e-78f9cbc5b91d tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] HTTP exception thrown: Volume 034572c4-9326-47b7-9001-8198bd38adba could not be found. Jun 01 04:27:45.734240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-0c66f611-62e6-4aed-8d4e-78f9cbc5b91d tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] Request method failure captured: Jun 01 04:27:45.734240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: request: DELETE /compute/v2.1/os-volumes/034572c4-9326-47b7-9001-8198bd38adba HTTP/1.1 Jun 01 04:27:45.734240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept: application/json Jun 01 04:27:45.734240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept-Encoding: identity Jun 01 04:27:45.734240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Connection: close Jun 01 04:27:45.734240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Length: 0 Jun 01 04:27:45.734240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Type: application/json Jun 01 04:27:45.734240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Host: 10.222.0.18 Jun 01 04:27:45.734240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Openstack-System-Scope: None Jun 01 04:27:45.734240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: User-Agent: python-urllib3/1.26.9 Jun 01 04:27:45.734240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Auth-Token: gAAAAABiluqugsXXNwtlZC7hWJYCIxE4JBgmtpQLqkXtV06Msviuf8n64X127uO8oSbKvorc947AopVkKN93WOeYHkwDrVWrZIG8Fi2yWHjaNq1I2UplQu4RX-vxlnf3JYlH_SE3D_epXwHIFeDF2KrLDxxweKD5ARfM0DrHrUOQ2cpwWrdxELM Jun 01 04:27:45.734240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Id: None Jun 01 04:27:45.734240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Name: None Jun 01 04:27:45.734240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Identity-Status: Confirmed Jun 01 04:27:45.734240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Is-Admin-Project: True Jun 01 04:27:45.734240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Id: default Jun 01 04:27:45.734240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Name: Default Jun 01 04:27:45.734240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Id: 7a45f5b11ffc4a99b4d7d7b8fbf86838 Jun 01 04:27:45.734240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-485319763 Jun 01 04:27:45.734240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Role: reader,member Jun 01 04:27:45.734240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Roles: reader,member Jun 01 04:27:45.741422 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7a45f5b11ffc4a99b4d7d7b8fbf86838"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7a45f5b11ffc4a99b4d7d7b8fbf86838"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7a45f5b11ffc4a99b4d7d7b8fbf86838"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7a45f5b11ffc4a99b4d7d7b8fbf86838"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:27:45.741422 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant: tempest-VolumesSnapshotsTestJSON-485319763 Jun 01 04:27:45.741422 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Id: 7a45f5b11ffc4a99b4d7d7b8fbf86838 Jun 01 04:27:45.741422 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-485319763 Jun 01 04:27:45.741422 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User: tempest-VolumesSnapshotsTestJSON-485319763-project Jun 01 04:27:45.741422 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Id: default Jun 01 04:27:45.741422 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Name: Default Jun 01 04:27:45.741422 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Id: 4801021c8f4741d9952c5db2f0e22f1a Jun 01 04:27:45.741422 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Name: tempest-VolumesSnapshotsTestJSON-485319763-project Jun 01 04:27:45.741422 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: method: Jun 01 04:27:45.741422 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: exception: Volume 034572c4-9326-47b7-9001-8198bd38adba could not be found. Jun 01 04:27:45.741422 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: action_args: {'id': '034572c4-9326-47b7-9001-8198bd38adba'} Jun 01 04:27:45.741422 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:27:45.742847 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:45.742847 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 01 04:27:45.742847 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 01 04:27:45.742847 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 01 04:27:45.742847 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 01 04:27:45.742847 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 01 04:27:45.742847 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 01 04:27:45.742847 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 01 04:27:45.742847 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 01 04:27:45.742847 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 01 04:27:45.742847 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 01 04:27:45.742847 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 01 04:27:45.742847 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 01 04:27:45.742847 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 01 04:27:45.742847 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 01 04:27:45.742847 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 034572c4-9326-47b7-9001-8198bd38adba could not be found. (HTTP 404) (Request-ID: req-211720d1-5d90-4c9b-a14d-efb30825e393) Jun 01 04:27:45.742847 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:27:45.742847 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:27:45.742847 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:27:45.744069 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:45.744069 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 01 04:27:45.744069 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 01 04:27:45.744069 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 01 04:27:45.744069 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 01 04:27:45.744069 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 01 04:27:45.744069 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 01 04:27:45.744069 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 01 04:27:45.744069 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 01 04:27:45.744069 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 01 04:27:45.744069 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 01 04:27:45.744069 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 01 04:27:45.744069 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 01 04:27:45.744069 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 01 04:27:45.744069 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 01 04:27:45.744069 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 01 04:27:45.744069 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 01 04:27:45.744069 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 01 04:27:45.744069 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 01 04:27:45.745723 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 01 04:27:45.745723 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 01 04:27:45.745723 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 01 04:27:45.745723 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 01 04:27:45.745723 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 034572c4-9326-47b7-9001-8198bd38adba could not be found. Jun 01 04:27:45.745723 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:27:45.745723 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:27:45.745723 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:27:45.745723 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:45.745723 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:27:45.745723 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:27:45.745723 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:27:45.745723 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:27:45.745723 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 01 04:27:45.745723 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 01 04:27:45.745723 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:27:45.745723 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:27:45.745723 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 01 04:27:45.745723 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:27:45.746811 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 034572c4-9326-47b7-9001-8198bd38adba could not be found. Jun 01 04:27:45.746811 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:27:45.746811 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:27:45.746811 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:27:45.746811 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:45.746811 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:27:45.746811 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:27:45.746811 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:27:45.746811 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:27:45.746811 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 034572c4-9326-47b7-9001-8198bd38adba could not be found. Jun 01 04:27:45.746811 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:27:45.746811 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-0c66f611-62e6-4aed-8d4e-78f9cbc5b91d tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] Returning 404 to user: Volume 034572c4-9326-47b7-9001-8198bd38adba could not be found. {{(pid=118516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:27:45.746811 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-0c66f611-62e6-4aed-8d4e-78f9cbc5b91d tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/034572c4-9326-47b7-9001-8198bd38adba" status: 404 len: 109 microversion: 2.1 time: 0.183502 Jun 01 04:27:45.746811 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 18/44] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jun 1 04:27:45 2022] DELETE /compute/v2.1/os-volumes/034572c4-9326-47b7-9001-8198bd38adba => generated 109 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 01 04:27:45.751993 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-db066113-9275-4248-8d1e-1ffa3266970f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:45.755747 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-db066113-9275-4248-8d1e-1ffa3266970f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:45.862611 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-db066113-9275-4248-8d1e-1ffa3266970f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:45.870516 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-db066113-9275-4248-8d1e-1ffa3266970f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1222 microversion: 2.1 time: 0.131655 Jun 01 04:27:45.874342 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 19/45] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:45 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1222 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:27:45.882036 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-5deee7cc-7302-48a1-8d28-24b56d149e52 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:45.886484 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-5deee7cc-7302-48a1-8d28-24b56d149e52 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:45.908341 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5deee7cc-7302-48a1-8d28-24b56d149e52 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:45.908680 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5deee7cc-7302-48a1-8d28-24b56d149e52 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:45.909839 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5deee7cc-7302-48a1-8d28-24b56d149e52 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:45.910744 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5deee7cc-7302-48a1-8d28-24b56d149e52 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:46.265670 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-5deee7cc-7302-48a1-8d28-24b56d149e52 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:46.275940 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-5deee7cc-7302-48a1-8d28-24b56d149e52 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.399970 Jun 01 04:27:46.284071 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 20/46] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:45 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:27:46.293687 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b589e319-7f67-4524-ab31-ce628354bc8b tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] Calling method '.version_select at 0x7ff325da0d30>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:46.352686 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.wsgi [None req-b589e319-7f67-4524-ab31-ce628354bc8b tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] HTTP exception thrown: Volume 034572c4-9326-47b7-9001-8198bd38adba could not be found. Jun 01 04:27:46.356282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b589e319-7f67-4524-ab31-ce628354bc8b tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] Request method failure captured: Jun 01 04:27:46.356282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: request: GET /compute/v2.1/os-volumes/034572c4-9326-47b7-9001-8198bd38adba HTTP/1.1 Jun 01 04:27:46.356282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept: application/json Jun 01 04:27:46.356282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept-Encoding: identity Jun 01 04:27:46.356282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Connection: close Jun 01 04:27:46.356282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Length: 0 Jun 01 04:27:46.356282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Type: application/json Jun 01 04:27:46.356282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Host: 10.222.0.18 Jun 01 04:27:46.356282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Openstack-System-Scope: None Jun 01 04:27:46.356282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: User-Agent: python-urllib3/1.26.9 Jun 01 04:27:46.356282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Auth-Token: gAAAAABiluqugsXXNwtlZC7hWJYCIxE4JBgmtpQLqkXtV06Msviuf8n64X127uO8oSbKvorc947AopVkKN93WOeYHkwDrVWrZIG8Fi2yWHjaNq1I2UplQu4RX-vxlnf3JYlH_SE3D_epXwHIFeDF2KrLDxxweKD5ARfM0DrHrUOQ2cpwWrdxELM Jun 01 04:27:46.356282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Id: None Jun 01 04:27:46.356282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Name: None Jun 01 04:27:46.356282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Identity-Status: Confirmed Jun 01 04:27:46.356282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Is-Admin-Project: True Jun 01 04:27:46.356282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Id: default Jun 01 04:27:46.356282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Name: Default Jun 01 04:27:46.356282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Id: 7a45f5b11ffc4a99b4d7d7b8fbf86838 Jun 01 04:27:46.356282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-485319763 Jun 01 04:27:46.356282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Role: reader,member Jun 01 04:27:46.356282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Roles: reader,member Jun 01 04:27:46.357667 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7a45f5b11ffc4a99b4d7d7b8fbf86838"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7a45f5b11ffc4a99b4d7d7b8fbf86838"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7a45f5b11ffc4a99b4d7d7b8fbf86838"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7a45f5b11ffc4a99b4d7d7b8fbf86838"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:27:46.357667 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant: tempest-VolumesSnapshotsTestJSON-485319763 Jun 01 04:27:46.357667 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Id: 7a45f5b11ffc4a99b4d7d7b8fbf86838 Jun 01 04:27:46.357667 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-485319763 Jun 01 04:27:46.357667 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User: tempest-VolumesSnapshotsTestJSON-485319763-project Jun 01 04:27:46.357667 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Id: default Jun 01 04:27:46.357667 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Name: Default Jun 01 04:27:46.357667 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Id: 4801021c8f4741d9952c5db2f0e22f1a Jun 01 04:27:46.357667 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Name: tempest-VolumesSnapshotsTestJSON-485319763-project Jun 01 04:27:46.357667 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: method: Jun 01 04:27:46.357667 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: exception: Volume 034572c4-9326-47b7-9001-8198bd38adba could not be found. Jun 01 04:27:46.357667 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: action_args: {'id': '034572c4-9326-47b7-9001-8198bd38adba'} Jun 01 04:27:46.357667 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:27:46.358335 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:46.358335 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 01 04:27:46.358335 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 01 04:27:46.358335 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 01 04:27:46.358335 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 01 04:27:46.358335 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 01 04:27:46.358335 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 01 04:27:46.358335 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 01 04:27:46.358335 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 01 04:27:46.358335 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 01 04:27:46.358335 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 01 04:27:46.358335 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 01 04:27:46.358335 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 01 04:27:46.358335 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 01 04:27:46.358335 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 01 04:27:46.358335 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 034572c4-9326-47b7-9001-8198bd38adba could not be found. (HTTP 404) (Request-ID: req-2a9b4d3c-f8f2-4cf4-a584-c191ff21b763) Jun 01 04:27:46.358335 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:27:46.358335 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:27:46.358335 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:27:46.359230 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:46.359230 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 01 04:27:46.359230 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 01 04:27:46.359230 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 01 04:27:46.359230 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 01 04:27:46.359230 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 01 04:27:46.359230 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 01 04:27:46.359230 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 01 04:27:46.359230 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 01 04:27:46.359230 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 01 04:27:46.359230 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 01 04:27:46.359230 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 01 04:27:46.359230 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 01 04:27:46.359230 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 01 04:27:46.359230 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 01 04:27:46.359230 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 01 04:27:46.359230 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 01 04:27:46.359230 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 01 04:27:46.359230 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 01 04:27:46.360165 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 01 04:27:46.360165 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 01 04:27:46.360165 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 01 04:27:46.360165 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 01 04:27:46.360165 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 034572c4-9326-47b7-9001-8198bd38adba could not be found. Jun 01 04:27:46.360165 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:27:46.360165 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:27:46.360165 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:27:46.360165 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:46.360165 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:27:46.360165 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:27:46.360165 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:27:46.360165 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:27:46.360165 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 01 04:27:46.360165 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 01 04:27:46.360165 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:27:46.360165 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:27:46.360165 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 01 04:27:46.360165 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:27:46.361072 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 034572c4-9326-47b7-9001-8198bd38adba could not be found. Jun 01 04:27:46.361072 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:27:46.361072 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:27:46.361072 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:27:46.361072 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:27:46.361072 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:27:46.361072 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:27:46.361072 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:27:46.361072 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:27:46.361072 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 034572c4-9326-47b7-9001-8198bd38adba could not be found. Jun 01 04:27:46.361072 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:27:46.362496 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b589e319-7f67-4524-ab31-ce628354bc8b tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] Returning 404 to user: Volume 034572c4-9326-47b7-9001-8198bd38adba could not be found. {{(pid=118516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:27:46.364161 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-b589e319-7f67-4524-ab31-ce628354bc8b tempest-VolumesSnapshotsTestJSON-485319763 tempest-VolumesSnapshotsTestJSON-485319763-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/034572c4-9326-47b7-9001-8198bd38adba" status: 404 len: 109 microversion: 2.1 time: 0.078900 Jun 01 04:27:46.364889 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 21/47] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 1 04:27:46 2022] GET /compute/v2.1/os-volumes/034572c4-9326-47b7-9001-8198bd38adba => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:27:46.759533 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-ece8cb34-3639-464b-a8be-384df70271ac tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Flavor limits 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 01 04:27:46.761207 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-ece8cb34-3639-464b-a8be-384df70271ac tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Image limits 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 01 04:27:46.762908 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-ece8cb34-3639-464b-a8be-384df70271ac tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Flavor pref 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 01 04:27:46.764081 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-ece8cb34-3639-464b-a8be-384df70271ac tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Image pref 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 01 04:27:46.764735 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-ece8cb34-3639-464b-a8be-384df70271ac tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 01 04:27:46.785548 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ece8cb34-3639-464b-a8be-384df70271ac tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:46.786602 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ece8cb34-3639-464b-a8be-384df70271ac tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:46.793705 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ece8cb34-3639-464b-a8be-384df70271ac tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:46.794442 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ece8cb34-3639-464b-a8be-384df70271ac tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:46.850626 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.quota [None req-ece8cb34-3639-464b-a8be-384df70271ac tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Getting quotas for project d12a9b5dc38b4aa7aed77adc89d0e6a4. Resources: {'ram', 'instances', 'cores'} {{(pid=118517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:27:46.859845 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.quota [None req-ece8cb34-3639-464b-a8be-384df70271ac tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Getting quotas for user 85df2f6595d3489bb5d1d547cb2cd900 and project d12a9b5dc38b4aa7aed77adc89d0e6a4. Resources: {'ram', 'instances', 'cores'} {{(pid=118517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:27:46.876707 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-ece8cb34-3639-464b-a8be-384df70271ac tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Going to run 1 instances... {{(pid=118517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 01 04:27:46.879453 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-ece8cb34-3639-464b-a8be-384df70271ac tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14321baa-3ac5-4c53-8054-4945abce5b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 01 04:27:46.921954 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-1823371c-71aa-4a82-98e7-4ab0c83dc358 req-47ee1b5c-cef0-4cd8-9db8-c008774809d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb2f4fea-bee1-42d9-8db6-985d2f390991", "tag": "26362886-e304-4f86-af04-dede6afa3f35"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:27:46.948177 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-1823371c-71aa-4a82-98e7-4ab0c83dc358 req-47ee1b5c-cef0-4cd8-9db8-c008774809d5 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:46.950834 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-1823371c-71aa-4a82-98e7-4ab0c83dc358 req-47ee1b5c-cef0-4cd8-9db8-c008774809d5 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:46.998212 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-1823371c-71aa-4a82-98e7-4ab0c83dc358 req-47ee1b5c-cef0-4cd8-9db8-c008774809d5 service nova] Creating event network-changed:26362886-e304-4f86-af04-dede6afa3f35 for instance bb2f4fea-bee1-42d9-8db6-985d2f390991 on hv-cinder-66710 Jun 01 04:27:46.999003 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-1823371c-71aa-4a82-98e7-4ab0c83dc358 req-47ee1b5c-cef0-4cd8-9db8-c008774809d5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 01 04:27:47.005549 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-123d9d14-b23b-4ede-8544-c8fd71b35381 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:47.006010 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-123d9d14-b23b-4ede-8544-c8fd71b35381 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:47.006832 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-123d9d14-b23b-4ede-8544-c8fd71b35381 None None] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:47.007600 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-123d9d14-b23b-4ede-8544-c8fd71b35381 None None] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:47.040514 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.compute.rpcapi [None req-123d9d14-b23b-4ede-8544-c8fd71b35381 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 01 04:27:47.042464 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-123d9d14-b23b-4ede-8544-c8fd71b35381 None None] Releasing lock "compute-rpcapi-router" {{(pid=118516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 01 04:27:47.043107 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-ece8cb34-3639-464b-a8be-384df70271ac tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.720158 Jun 01 04:27:47.048919 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 27/48] 10.222.0.18 () {62 vars in 1187 bytes} [Wed Jun 1 04:27:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 1727 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 01 04:27:47.053738 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-82b88a59-c72d-45ef-b1e3-a03427a12180 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:47.058234 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-82b88a59-c72d-45ef-b1e3-a03427a12180 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:47.080847 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-82b88a59-c72d-45ef-b1e3-a03427a12180 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:47.081389 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-82b88a59-c72d-45ef-b1e3-a03427a12180 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:47.082291 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-82b88a59-c72d-45ef-b1e3-a03427a12180 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:47.082816 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-82b88a59-c72d-45ef-b1e3-a03427a12180 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:47.091627 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-123d9d14-b23b-4ede-8544-c8fd71b35381 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.264592 Jun 01 04:27:47.097202 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 22/49] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:27:47.106686 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-032d8788-5952-4c45-b6de-2c940df3fb1e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:47.107348 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-032d8788-5952-4c45-b6de-2c940df3fb1e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:47.189765 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-032d8788-5952-4c45-b6de-2c940df3fb1e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:47.203337 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-032d8788-5952-4c45-b6de-2c940df3fb1e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:47.203337 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-032d8788-5952-4c45-b6de-2c940df3fb1e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:47.204151 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-032d8788-5952-4c45-b6de-2c940df3fb1e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1282 microversion: 2.20 time: 0.105440 Jun 01 04:27:47.205915 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 23/50] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:27:47 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1282 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:27:47.230964 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-82b88a59-c72d-45ef-b1e3-a03427a12180 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:47.244044 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-82b88a59-c72d-45ef-b1e3-a03427a12180 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1226 microversion: 2.1 time: 0.191983 Jun 01 04:27:47.245541 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 28/51] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:47 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1226 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:27:47.301072 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b0cedf09-50da-4a90-a611-52baee1cce9e tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:47.308929 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-b0cedf09-50da-4a90-a611-52baee1cce9e tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:47.331163 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b0cedf09-50da-4a90-a611-52baee1cce9e tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:47.332999 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b0cedf09-50da-4a90-a611-52baee1cce9e tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:47.335484 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b0cedf09-50da-4a90-a611-52baee1cce9e tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:47.361122 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b0cedf09-50da-4a90-a611-52baee1cce9e tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:47.593445 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b0cedf09-50da-4a90-a611-52baee1cce9e tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:47.600890 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-b0cedf09-50da-4a90-a611-52baee1cce9e tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.304223 Jun 01 04:27:47.601690 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 24/52] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:47 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:27:48.222562 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-117d0b9e-8dc6-452a-9a8b-88441abac139 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:48.223387 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-117d0b9e-8dc6-452a-9a8b-88441abac139 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:48.264343 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b7a6914c-28ae-44f7-8e85-70320359b3da tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:48.274816 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-b7a6914c-28ae-44f7-8e85-70320359b3da tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:48.288939 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b7a6914c-28ae-44f7-8e85-70320359b3da tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:48.289415 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b7a6914c-28ae-44f7-8e85-70320359b3da tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:48.290229 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b7a6914c-28ae-44f7-8e85-70320359b3da tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:48.294436 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b7a6914c-28ae-44f7-8e85-70320359b3da tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:48.350886 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-117d0b9e-8dc6-452a-9a8b-88441abac139 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:48.366961 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-117d0b9e-8dc6-452a-9a8b-88441abac139 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:48.373386 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-117d0b9e-8dc6-452a-9a8b-88441abac139 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:48.373386 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-117d0b9e-8dc6-452a-9a8b-88441abac139 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1282 microversion: 2.20 time: 0.154987 Jun 01 04:27:48.383880 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 29/53] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:27:48 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1282 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:27:48.434263 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b7a6914c-28ae-44f7-8e85-70320359b3da tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:48.442523 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-b7a6914c-28ae-44f7-8e85-70320359b3da tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1226 microversion: 2.1 time: 0.184601 Jun 01 04:27:48.444016 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 25/54] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:48 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1226 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:27:48.619548 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-55c4ae81-804a-4930-a49d-cfd3ae33474c tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:48.619665 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-55c4ae81-804a-4930-a49d-cfd3ae33474c tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:48.626274 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-55c4ae81-804a-4930-a49d-cfd3ae33474c tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:48.626912 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-55c4ae81-804a-4930-a49d-cfd3ae33474c tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:48.627989 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-55c4ae81-804a-4930-a49d-cfd3ae33474c tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:48.628568 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-55c4ae81-804a-4930-a49d-cfd3ae33474c tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:49.014842 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-55c4ae81-804a-4930-a49d-cfd3ae33474c tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:49.022290 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-55c4ae81-804a-4930-a49d-cfd3ae33474c tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.407691 Jun 01 04:27:49.022862 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 30/55] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:48 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:27:49.392800 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-cdfb03cd-c83a-4214-80eb-b2f7783fdeca tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:49.394020 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-cdfb03cd-c83a-4214-80eb-b2f7783fdeca tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:49.408603 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cdfb03cd-c83a-4214-80eb-b2f7783fdeca tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:49.409773 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cdfb03cd-c83a-4214-80eb-b2f7783fdeca tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:49.413323 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cdfb03cd-c83a-4214-80eb-b2f7783fdeca tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:49.413323 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cdfb03cd-c83a-4214-80eb-b2f7783fdeca tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:49.466315 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-126f7a04-a5eb-4260-97f9-cbaf349b5213 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:49.477137 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-126f7a04-a5eb-4260-97f9-cbaf349b5213 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:49.479077 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-126f7a04-a5eb-4260-97f9-cbaf349b5213 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:49.479949 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-126f7a04-a5eb-4260-97f9-cbaf349b5213 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:49.481570 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-126f7a04-a5eb-4260-97f9-cbaf349b5213 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:49.482288 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-126f7a04-a5eb-4260-97f9-cbaf349b5213 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:49.533802 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-cdfb03cd-c83a-4214-80eb-b2f7783fdeca tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:49.547056 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-cdfb03cd-c83a-4214-80eb-b2f7783fdeca tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:49.549901 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-cdfb03cd-c83a-4214-80eb-b2f7783fdeca tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:49.551553 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-cdfb03cd-c83a-4214-80eb-b2f7783fdeca tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1286 microversion: 2.20 time: 0.162636 Jun 01 04:27:49.562334 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 26/56] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:27:49 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1286 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:27:49.614867 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-126f7a04-a5eb-4260-97f9-cbaf349b5213 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:49.626732 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-126f7a04-a5eb-4260-97f9-cbaf349b5213 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1226 microversion: 2.1 time: 0.168823 Jun 01 04:27:49.626732 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 31/57] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:49 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1226 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:27:50.039786 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-0d4bcb45-8733-4ec5-a10e-0574de1a3ef7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:50.040541 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-0d4bcb45-8733-4ec5-a10e-0574de1a3ef7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:50.052597 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0d4bcb45-8733-4ec5-a10e-0574de1a3ef7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:50.054974 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0d4bcb45-8733-4ec5-a10e-0574de1a3ef7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:50.054974 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0d4bcb45-8733-4ec5-a10e-0574de1a3ef7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:50.054974 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0d4bcb45-8733-4ec5-a10e-0574de1a3ef7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:50.306633 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-0d4bcb45-8733-4ec5-a10e-0574de1a3ef7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:50.314702 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-0d4bcb45-8733-4ec5-a10e-0574de1a3ef7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.279511 Jun 01 04:27:50.315650 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 27/58] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:50 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:27:50.570326 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-cfc5bfe4-f1c2-4b69-835f-a81c0358c0a3 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:50.578383 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-cfc5bfe4-f1c2-4b69-835f-a81c0358c0a3 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:50.578383 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-cfc5bfe4-f1c2-4b69-835f-a81c0358c0a3 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:50.578383 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-cfc5bfe4-f1c2-4b69-835f-a81c0358c0a3 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:50.579125 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-cfc5bfe4-f1c2-4b69-835f-a81c0358c0a3 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:50.579587 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-cfc5bfe4-f1c2-4b69-835f-a81c0358c0a3 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:50.641548 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-cfc5bfe4-f1c2-4b69-835f-a81c0358c0a3 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:50.643230 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-3a8f4b1b-1098-40e5-8723-18d1dcf7bfa7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:50.644099 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-3a8f4b1b-1098-40e5-8723-18d1dcf7bfa7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:50.650037 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3a8f4b1b-1098-40e5-8723-18d1dcf7bfa7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:50.650431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-cfc5bfe4-f1c2-4b69-835f-a81c0358c0a3 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:50.650563 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3a8f4b1b-1098-40e5-8723-18d1dcf7bfa7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:50.651256 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3a8f4b1b-1098-40e5-8723-18d1dcf7bfa7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:50.652093 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3a8f4b1b-1098-40e5-8723-18d1dcf7bfa7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:50.652402 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-cfc5bfe4-f1c2-4b69-835f-a81c0358c0a3 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:50.653860 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-cfc5bfe4-f1c2-4b69-835f-a81c0358c0a3 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1286 microversion: 2.20 time: 0.087609 Jun 01 04:27:50.654350 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 32/59] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:27:50 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:27:50.856448 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-3a8f4b1b-1098-40e5-8723-18d1dcf7bfa7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:50.868788 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-3a8f4b1b-1098-40e5-8723-18d1dcf7bfa7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1226 microversion: 2.1 time: 0.230194 Jun 01 04:27:50.869481 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 28/60] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:50 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1226 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:27:51.338259 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-9b72158d-87cc-4137-94d2-f514fd2cfd74 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:51.339087 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-9b72158d-87cc-4137-94d2-f514fd2cfd74 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:51.345879 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9b72158d-87cc-4137-94d2-f514fd2cfd74 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:51.346332 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9b72158d-87cc-4137-94d2-f514fd2cfd74 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:51.347104 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9b72158d-87cc-4137-94d2-f514fd2cfd74 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:51.347616 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9b72158d-87cc-4137-94d2-f514fd2cfd74 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:51.493125 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-9b72158d-87cc-4137-94d2-f514fd2cfd74 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:51.501328 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-9b72158d-87cc-4137-94d2-f514fd2cfd74 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.166990 Jun 01 04:27:51.502209 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 33/61] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:51 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:27:51.673098 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-a80b9a16-0321-4705-a820-3491669e3bb1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:51.673719 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-a80b9a16-0321-4705-a820-3491669e3bb1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:51.680169 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a80b9a16-0321-4705-a820-3491669e3bb1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:51.680630 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a80b9a16-0321-4705-a820-3491669e3bb1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:51.681415 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a80b9a16-0321-4705-a820-3491669e3bb1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:51.681867 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a80b9a16-0321-4705-a820-3491669e3bb1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:51.743252 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-a80b9a16-0321-4705-a820-3491669e3bb1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:51.751097 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-a80b9a16-0321-4705-a820-3491669e3bb1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:51.752687 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-a80b9a16-0321-4705-a820-3491669e3bb1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:51.756994 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-a80b9a16-0321-4705-a820-3491669e3bb1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1286 microversion: 2.20 time: 0.085757 Jun 01 04:27:51.756994 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 29/62] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:27:51 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:27:51.889454 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-6ac3ad4d-5542-4119-b669-e186fa1e3c8f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:51.890751 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-6ac3ad4d-5542-4119-b669-e186fa1e3c8f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:51.904079 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6ac3ad4d-5542-4119-b669-e186fa1e3c8f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:51.904626 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6ac3ad4d-5542-4119-b669-e186fa1e3c8f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:51.906156 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6ac3ad4d-5542-4119-b669-e186fa1e3c8f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:51.907810 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6ac3ad4d-5542-4119-b669-e186fa1e3c8f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:51.998833 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-6ac3ad4d-5542-4119-b669-e186fa1e3c8f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:52.007188 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-6ac3ad4d-5542-4119-b669-e186fa1e3c8f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1226 microversion: 2.1 time: 0.122682 Jun 01 04:27:52.007910 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 34/63] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:51 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1226 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:27:52.518913 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-1d36c440-fd5b-404c-9f1f-6fa50ac63467 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:52.519985 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-1d36c440-fd5b-404c-9f1f-6fa50ac63467 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:52.527289 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1d36c440-fd5b-404c-9f1f-6fa50ac63467 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:52.528619 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1d36c440-fd5b-404c-9f1f-6fa50ac63467 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:52.529831 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1d36c440-fd5b-404c-9f1f-6fa50ac63467 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:52.530354 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1d36c440-fd5b-404c-9f1f-6fa50ac63467 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:52.716617 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-1d36c440-fd5b-404c-9f1f-6fa50ac63467 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:52.731386 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-1d36c440-fd5b-404c-9f1f-6fa50ac63467 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.214769 Jun 01 04:27:52.731386 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 30/64] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:52 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:27:52.779987 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-84cdd902-aae8-4e2a-85f6-2c3a9fe10950 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:52.780594 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-84cdd902-aae8-4e2a-85f6-2c3a9fe10950 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:52.807321 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-84cdd902-aae8-4e2a-85f6-2c3a9fe10950 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:52.809219 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-84cdd902-aae8-4e2a-85f6-2c3a9fe10950 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:52.810212 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-84cdd902-aae8-4e2a-85f6-2c3a9fe10950 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:52.811204 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-84cdd902-aae8-4e2a-85f6-2c3a9fe10950 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:52.919901 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-84cdd902-aae8-4e2a-85f6-2c3a9fe10950 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:52.932651 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-84cdd902-aae8-4e2a-85f6-2c3a9fe10950 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:52.934271 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-84cdd902-aae8-4e2a-85f6-2c3a9fe10950 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:52.935344 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-84cdd902-aae8-4e2a-85f6-2c3a9fe10950 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1286 microversion: 2.20 time: 0.159901 Jun 01 04:27:52.939365 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 35/65] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:27:52 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1286 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:27:53.028189 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-8f4a4831-23ac-4b2d-90aa-d1efa3fc7a67 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:53.028189 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-8f4a4831-23ac-4b2d-90aa-d1efa3fc7a67 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:53.034574 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8f4a4831-23ac-4b2d-90aa-d1efa3fc7a67 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:53.035045 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8f4a4831-23ac-4b2d-90aa-d1efa3fc7a67 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:53.035859 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8f4a4831-23ac-4b2d-90aa-d1efa3fc7a67 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:53.036457 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8f4a4831-23ac-4b2d-90aa-d1efa3fc7a67 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:53.102985 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-8f4a4831-23ac-4b2d-90aa-d1efa3fc7a67 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:53.111532 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-8f4a4831-23ac-4b2d-90aa-d1efa3fc7a67 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1226 microversion: 2.1 time: 0.091318 Jun 01 04:27:53.112108 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 31/66] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:53 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:27:53.747711 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-97c45eba-90b6-4449-a732-adaff3368233 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:53.748319 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-97c45eba-90b6-4449-a732-adaff3368233 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:53.754875 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-97c45eba-90b6-4449-a732-adaff3368233 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:53.755361 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-97c45eba-90b6-4449-a732-adaff3368233 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:53.756123 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-97c45eba-90b6-4449-a732-adaff3368233 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:53.756560 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-97c45eba-90b6-4449-a732-adaff3368233 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:53.899660 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-97c45eba-90b6-4449-a732-adaff3368233 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:53.907863 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-97c45eba-90b6-4449-a732-adaff3368233 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.164710 Jun 01 04:27:53.908410 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 36/67] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:53 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:27:53.953806 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-3fcbb603-d46e-467a-9225-5c54595236cf tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:53.954392 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-3fcbb603-d46e-467a-9225-5c54595236cf tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:53.964400 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3fcbb603-d46e-467a-9225-5c54595236cf tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:53.965044 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3fcbb603-d46e-467a-9225-5c54595236cf tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:53.966195 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3fcbb603-d46e-467a-9225-5c54595236cf tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:53.966757 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3fcbb603-d46e-467a-9225-5c54595236cf tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:54.031324 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-3fcbb603-d46e-467a-9225-5c54595236cf tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:54.039526 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-3fcbb603-d46e-467a-9225-5c54595236cf tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:54.040987 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-3fcbb603-d46e-467a-9225-5c54595236cf tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:54.042086 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-3fcbb603-d46e-467a-9225-5c54595236cf tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1286 microversion: 2.20 time: 0.092313 Jun 01 04:27:54.042649 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 32/68] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:27:53 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:27:54.128477 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-d360c2f8-0f4a-4ead-aa34-d3367db727d5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:54.129202 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-d360c2f8-0f4a-4ead-aa34-d3367db727d5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:54.138887 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d360c2f8-0f4a-4ead-aa34-d3367db727d5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:54.139370 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d360c2f8-0f4a-4ead-aa34-d3367db727d5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:54.140147 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d360c2f8-0f4a-4ead-aa34-d3367db727d5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:54.140582 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d360c2f8-0f4a-4ead-aa34-d3367db727d5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:54.233141 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-d360c2f8-0f4a-4ead-aa34-d3367db727d5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:54.240121 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-d360c2f8-0f4a-4ead-aa34-d3367db727d5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1226 microversion: 2.1 time: 0.115364 Jun 01 04:27:54.241005 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 37/69] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:54 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1226 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:27:54.924763 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-de8242e7-800d-4e15-8808-cd402bc7e8ad tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:54.925458 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-de8242e7-800d-4e15-8808-cd402bc7e8ad tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:54.931509 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-de8242e7-800d-4e15-8808-cd402bc7e8ad tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:54.931968 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-de8242e7-800d-4e15-8808-cd402bc7e8ad tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:54.932751 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-de8242e7-800d-4e15-8808-cd402bc7e8ad tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:54.933194 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-de8242e7-800d-4e15-8808-cd402bc7e8ad tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:55.069049 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-b93d7a8c-33a3-4243-a76f-458d331c6149 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:55.070380 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-b93d7a8c-33a3-4243-a76f-458d331c6149 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:55.080650 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b93d7a8c-33a3-4243-a76f-458d331c6149 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:55.081545 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b93d7a8c-33a3-4243-a76f-458d331c6149 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:55.083132 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b93d7a8c-33a3-4243-a76f-458d331c6149 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:55.084230 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b93d7a8c-33a3-4243-a76f-458d331c6149 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:55.085010 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-de8242e7-800d-4e15-8808-cd402bc7e8ad tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:55.110788 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-de8242e7-800d-4e15-8808-cd402bc7e8ad tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.188020 Jun 01 04:27:55.110788 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 33/70] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:54 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:27:55.184504 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-b93d7a8c-33a3-4243-a76f-458d331c6149 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:55.192355 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-b93d7a8c-33a3-4243-a76f-458d331c6149 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:55.193869 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-b93d7a8c-33a3-4243-a76f-458d331c6149 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:55.194960 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-b93d7a8c-33a3-4243-a76f-458d331c6149 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1286 microversion: 2.20 time: 0.130115 Jun 01 04:27:55.195549 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 38/71] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:27:55 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1286 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:27:55.257677 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-e6813209-7273-4963-82a5-9fb5ab57d0de tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:55.258288 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-e6813209-7273-4963-82a5-9fb5ab57d0de tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:55.264873 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e6813209-7273-4963-82a5-9fb5ab57d0de tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:55.265378 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e6813209-7273-4963-82a5-9fb5ab57d0de tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:55.266319 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e6813209-7273-4963-82a5-9fb5ab57d0de tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:55.266909 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e6813209-7273-4963-82a5-9fb5ab57d0de tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:55.340808 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-e6813209-7273-4963-82a5-9fb5ab57d0de tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:55.349483 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-e6813209-7273-4963-82a5-9fb5ab57d0de tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1226 microversion: 2.1 time: 0.095503 Jun 01 04:27:55.350384 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 34/72] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:55 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:27:56.125924 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-bac2d775-39ce-4e6f-bb5f-d000a1811912 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:56.127880 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-bac2d775-39ce-4e6f-bb5f-d000a1811912 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:56.132710 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bac2d775-39ce-4e6f-bb5f-d000a1811912 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:56.133155 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bac2d775-39ce-4e6f-bb5f-d000a1811912 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:56.134033 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bac2d775-39ce-4e6f-bb5f-d000a1811912 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:56.134434 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bac2d775-39ce-4e6f-bb5f-d000a1811912 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:56.212822 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-0fadad93-ee83-492b-a4f7-44b81a1c4972 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:56.213430 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-0fadad93-ee83-492b-a4f7-44b81a1c4972 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:56.220156 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0fadad93-ee83-492b-a4f7-44b81a1c4972 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:56.220610 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0fadad93-ee83-492b-a4f7-44b81a1c4972 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:56.221379 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0fadad93-ee83-492b-a4f7-44b81a1c4972 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:56.221814 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0fadad93-ee83-492b-a4f7-44b81a1c4972 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:56.226859 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=100 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:56.268088 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-bac2d775-39ce-4e6f-bb5f-d000a1811912 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:56.275887 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-bac2d775-39ce-4e6f-bb5f-d000a1811912 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.153856 Jun 01 04:27:56.276691 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 39/73] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:56 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:27:56.283762 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-0fadad93-ee83-492b-a4f7-44b81a1c4972 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:56.291580 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-0fadad93-ee83-492b-a4f7-44b81a1c4972 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:56.293152 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-0fadad93-ee83-492b-a4f7-44b81a1c4972 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:56.294250 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-0fadad93-ee83-492b-a4f7-44b81a1c4972 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1286 microversion: 2.20 time: 0.085431 Jun 01 04:27:56.294801 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 35/74] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:27:56 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:27:56.365991 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-ca9120d0-f5f7-46a5-898e-7380c4954659 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:56.366810 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-ca9120d0-f5f7-46a5-898e-7380c4954659 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:56.370794 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:56.376083 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ca9120d0-f5f7-46a5-898e-7380c4954659 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:56.376722 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ca9120d0-f5f7-46a5-898e-7380c4954659 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:56.377499 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ca9120d0-f5f7-46a5-898e-7380c4954659 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:56.377921 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ca9120d0-f5f7-46a5-898e-7380c4954659 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:56.440823 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-ca9120d0-f5f7-46a5-898e-7380c4954659 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:56.448740 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-ca9120d0-f5f7-46a5-898e-7380c4954659 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1226 microversion: 2.1 time: 0.086705 Jun 01 04:27:56.449950 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 40/75] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:56 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:27:57.298098 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-a12c38f8-ca75-401b-a99a-7830dc1eaf77 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:57.308722 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-a12c38f8-ca75-401b-a99a-7830dc1eaf77 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:57.308722 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell0:SELECT=4 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:57.308722 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell0:SELECT=24 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:57.308722 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:57.308722 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a12c38f8-ca75-401b-a99a-7830dc1eaf77 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:57.308722 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a12c38f8-ca75-401b-a99a-7830dc1eaf77 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:57.309177 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a12c38f8-ca75-401b-a99a-7830dc1eaf77 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:57.309177 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a12c38f8-ca75-401b-a99a-7830dc1eaf77 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:57.311725 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-4b4bc37e-a181-473b-a279-f49b29b81f00 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:57.312329 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-4b4bc37e-a181-473b-a279-f49b29b81f00 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:57.314149 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell0:SELECT=4 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:57.319994 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4b4bc37e-a181-473b-a279-f49b29b81f00 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:57.320189 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4b4bc37e-a181-473b-a279-f49b29b81f00 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:57.321131 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4b4bc37e-a181-473b-a279-f49b29b81f00 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:57.321569 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4b4bc37e-a181-473b-a279-f49b29b81f00 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:57.382836 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-4b4bc37e-a181-473b-a279-f49b29b81f00 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:57.385675 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=100 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:57.391697 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-4b4bc37e-a181-473b-a279-f49b29b81f00 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:57.393134 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-4b4bc37e-a181-473b-a279-f49b29b81f00 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:57.394233 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-4b4bc37e-a181-473b-a279-f49b29b81f00 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1286 microversion: 2.20 time: 0.087019 Jun 01 04:27:57.394788 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 41/76] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:27:57 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:27:57.443371 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-a12c38f8-ca75-401b-a99a-7830dc1eaf77 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:57.451223 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-a12c38f8-ca75-401b-a99a-7830dc1eaf77 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.157865 Jun 01 04:27:57.451837 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 36/77] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:57 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:27:57.466375 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-f8795e9a-1723-4523-8b80-bef2e9250306 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:57.466988 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-f8795e9a-1723-4523-8b80-bef2e9250306 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:57.473106 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f8795e9a-1723-4523-8b80-bef2e9250306 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:57.473564 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f8795e9a-1723-4523-8b80-bef2e9250306 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:57.474316 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f8795e9a-1723-4523-8b80-bef2e9250306 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:57.474756 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f8795e9a-1723-4523-8b80-bef2e9250306 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:57.544076 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-f8795e9a-1723-4523-8b80-bef2e9250306 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:57.551652 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-f8795e9a-1723-4523-8b80-bef2e9250306 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1226 microversion: 2.1 time: 0.089447 Jun 01 04:27:57.552090 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 42/78] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:57 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:27:58.413090 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-06c25276-2b27-490f-85cb-99cdcdda8e56 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:58.413702 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-06c25276-2b27-490f-85cb-99cdcdda8e56 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:58.421089 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-06c25276-2b27-490f-85cb-99cdcdda8e56 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:58.421545 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-06c25276-2b27-490f-85cb-99cdcdda8e56 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:58.422325 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-06c25276-2b27-490f-85cb-99cdcdda8e56 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:58.422883 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-06c25276-2b27-490f-85cb-99cdcdda8e56 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:58.468621 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-9347a171-6a7c-42ce-8b37-09f57eba7eac tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:58.469394 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-9347a171-6a7c-42ce-8b37-09f57eba7eac tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:58.473580 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell0:SELECT=20 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:58.477799 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9347a171-6a7c-42ce-8b37-09f57eba7eac tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:58.478606 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9347a171-6a7c-42ce-8b37-09f57eba7eac tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:58.479528 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9347a171-6a7c-42ce-8b37-09f57eba7eac tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:58.480031 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9347a171-6a7c-42ce-8b37-09f57eba7eac tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:58.486345 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-06c25276-2b27-490f-85cb-99cdcdda8e56 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:58.494584 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-06c25276-2b27-490f-85cb-99cdcdda8e56 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:58.496252 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-06c25276-2b27-490f-85cb-99cdcdda8e56 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:58.497379 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-06c25276-2b27-490f-85cb-99cdcdda8e56 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1286 microversion: 2.20 time: 0.088262 Jun 01 04:27:58.499343 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 37/79] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:27:58 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:27:58.569998 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-e8c0368d-657b-4376-8881-040330651aeb tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:58.571499 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-e8c0368d-657b-4376-8881-040330651aeb tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:58.580823 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e8c0368d-657b-4376-8881-040330651aeb tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:58.582186 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e8c0368d-657b-4376-8881-040330651aeb tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:58.582669 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e8c0368d-657b-4376-8881-040330651aeb tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:58.583112 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e8c0368d-657b-4376-8881-040330651aeb tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:58.660458 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-e8c0368d-657b-4376-8881-040330651aeb tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:58.669333 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-e8c0368d-657b-4376-8881-040330651aeb tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1226 microversion: 2.1 time: 0.104225 Jun 01 04:27:58.670110 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 38/80] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:58 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:27:58.690232 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-9347a171-6a7c-42ce-8b37-09f57eba7eac tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:58.698061 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-9347a171-6a7c-42ce-8b37-09f57eba7eac tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.233845 Jun 01 04:27:58.698661 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 43/81] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:58 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:27:59.521413 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-0401d399-a1fd-4c25-917b-d894679451a2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:59.521413 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-0401d399-a1fd-4c25-917b-d894679451a2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:59.525515 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0401d399-a1fd-4c25-917b-d894679451a2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:59.525998 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0401d399-a1fd-4c25-917b-d894679451a2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:59.526769 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0401d399-a1fd-4c25-917b-d894679451a2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:59.527204 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0401d399-a1fd-4c25-917b-d894679451a2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:59.596135 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-0401d399-a1fd-4c25-917b-d894679451a2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:59.605041 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-0401d399-a1fd-4c25-917b-d894679451a2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:59.619454 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-0401d399-a1fd-4c25-917b-d894679451a2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:59.619454 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-0401d399-a1fd-4c25-917b-d894679451a2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1286 microversion: 2.20 time: 0.097522 Jun 01 04:27:59.619454 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 39/82] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:27:59 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:27:59.687033 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-7ef9831f-e9bc-4dd4-aacb-92cf26b17a8d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:59.687685 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-7ef9831f-e9bc-4dd4-aacb-92cf26b17a8d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:59.693846 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7ef9831f-e9bc-4dd4-aacb-92cf26b17a8d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:59.694292 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7ef9831f-e9bc-4dd4-aacb-92cf26b17a8d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:59.695049 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7ef9831f-e9bc-4dd4-aacb-92cf26b17a8d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:59.695525 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7ef9831f-e9bc-4dd4-aacb-92cf26b17a8d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:59.714961 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-baaeb754-c457-456f-a798-1ebf29537256 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:27:59.715606 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-baaeb754-c457-456f-a798-1ebf29537256 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:27:59.722537 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-baaeb754-c457-456f-a798-1ebf29537256 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:59.723279 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-baaeb754-c457-456f-a798-1ebf29537256 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:59.724251 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-baaeb754-c457-456f-a798-1ebf29537256 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:27:59.724695 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-baaeb754-c457-456f-a798-1ebf29537256 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:27:59.779326 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-7ef9831f-e9bc-4dd4-aacb-92cf26b17a8d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:59.787904 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-7ef9831f-e9bc-4dd4-aacb-92cf26b17a8d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1226 microversion: 2.1 time: 0.105157 Jun 01 04:27:59.788516 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 44/83] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:59 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:27:59.913515 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-baaeb754-c457-456f-a798-1ebf29537256 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:27:59.921602 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-baaeb754-c457-456f-a798-1ebf29537256 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.210485 Jun 01 04:27:59.922551 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 40/84] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:27:59 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:28:00.629605 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-5cddffc2-0b75-4f68-9280-c25833e67d2a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:00.630321 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-5cddffc2-0b75-4f68-9280-c25833e67d2a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:00.637245 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5cddffc2-0b75-4f68-9280-c25833e67d2a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:00.637739 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5cddffc2-0b75-4f68-9280-c25833e67d2a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:00.639176 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5cddffc2-0b75-4f68-9280-c25833e67d2a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:00.639749 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5cddffc2-0b75-4f68-9280-c25833e67d2a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:00.704501 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-5cddffc2-0b75-4f68-9280-c25833e67d2a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:00.713363 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-5cddffc2-0b75-4f68-9280-c25833e67d2a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:00.715086 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-5cddffc2-0b75-4f68-9280-c25833e67d2a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:00.716204 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-5cddffc2-0b75-4f68-9280-c25833e67d2a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1286 microversion: 2.20 time: 0.093355 Jun 01 04:28:00.717375 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 45/85] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:28:00 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:28:00.804984 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b2810084-3465-4d23-8dda-6432a49a15d4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:00.806196 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-b2810084-3465-4d23-8dda-6432a49a15d4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:00.813491 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b2810084-3465-4d23-8dda-6432a49a15d4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:00.814129 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b2810084-3465-4d23-8dda-6432a49a15d4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:00.815133 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b2810084-3465-4d23-8dda-6432a49a15d4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:00.815790 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b2810084-3465-4d23-8dda-6432a49a15d4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:00.891717 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b2810084-3465-4d23-8dda-6432a49a15d4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:00.900305 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-b2810084-3465-4d23-8dda-6432a49a15d4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1218 microversion: 2.1 time: 0.099405 Jun 01 04:28:00.901054 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 41/86] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:00 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:00.937773 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-94cec4e0-51b7-468a-9b5a-6acfafdcb362 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:00.938383 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-94cec4e0-51b7-468a-9b5a-6acfafdcb362 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:00.944429 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-94cec4e0-51b7-468a-9b5a-6acfafdcb362 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:00.945552 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-94cec4e0-51b7-468a-9b5a-6acfafdcb362 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:00.945795 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-94cec4e0-51b7-468a-9b5a-6acfafdcb362 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:00.946233 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-94cec4e0-51b7-468a-9b5a-6acfafdcb362 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:01.085710 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-94cec4e0-51b7-468a-9b5a-6acfafdcb362 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:01.093564 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-94cec4e0-51b7-468a-9b5a-6acfafdcb362 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.159536 Jun 01 04:28:01.094138 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 46/87] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:00 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:01.736543 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d5ae31ff-2da5-462b-bbe9-83476d36f42f tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:01.738040 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-d5ae31ff-2da5-462b-bbe9-83476d36f42f tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:01.746630 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d5ae31ff-2da5-462b-bbe9-83476d36f42f tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:01.747013 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d5ae31ff-2da5-462b-bbe9-83476d36f42f tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:01.748414 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d5ae31ff-2da5-462b-bbe9-83476d36f42f tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:01.752023 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d5ae31ff-2da5-462b-bbe9-83476d36f42f tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:01.811239 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-d5ae31ff-2da5-462b-bbe9-83476d36f42f tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:01.819449 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-d5ae31ff-2da5-462b-bbe9-83476d36f42f tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:01.821024 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-d5ae31ff-2da5-462b-bbe9-83476d36f42f tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:01.822362 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-d5ae31ff-2da5-462b-bbe9-83476d36f42f tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1286 microversion: 2.20 time: 0.091403 Jun 01 04:28:01.822928 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 42/88] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:28:01 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:28:01.918825 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a8cca1a5-5210-4536-873e-0805bdcfb8fc tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:01.921332 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-a8cca1a5-5210-4536-873e-0805bdcfb8fc tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:01.932833 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a8cca1a5-5210-4536-873e-0805bdcfb8fc tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:01.933597 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a8cca1a5-5210-4536-873e-0805bdcfb8fc tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:01.934576 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a8cca1a5-5210-4536-873e-0805bdcfb8fc tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:01.935709 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a8cca1a5-5210-4536-873e-0805bdcfb8fc tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:02.089776 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-a8cca1a5-5210-4536-873e-0805bdcfb8fc tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:02.098859 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-a8cca1a5-5210-4536-873e-0805bdcfb8fc tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1218 microversion: 2.1 time: 0.184572 Jun 01 04:28:02.099884 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 47/89] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:01 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1218 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:02.110591 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-ebab5e23-8e30-4dce-a8d3-f8797269b6da tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:02.111209 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-ebab5e23-8e30-4dce-a8d3-f8797269b6da tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:02.119369 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ebab5e23-8e30-4dce-a8d3-f8797269b6da tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:02.120190 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ebab5e23-8e30-4dce-a8d3-f8797269b6da tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:02.121755 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ebab5e23-8e30-4dce-a8d3-f8797269b6da tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:02.122354 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ebab5e23-8e30-4dce-a8d3-f8797269b6da tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:02.375110 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-ebab5e23-8e30-4dce-a8d3-f8797269b6da tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:02.382726 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-ebab5e23-8e30-4dce-a8d3-f8797269b6da tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.276626 Jun 01 04:28:02.383345 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 43/90] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:02 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:02.840998 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-3b5f6250-abb1-4c96-8181-5a537b3a1f10 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:02.842048 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-3b5f6250-abb1-4c96-8181-5a537b3a1f10 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:02.848373 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3b5f6250-abb1-4c96-8181-5a537b3a1f10 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:02.848825 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3b5f6250-abb1-4c96-8181-5a537b3a1f10 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:02.849600 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3b5f6250-abb1-4c96-8181-5a537b3a1f10 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:02.850063 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3b5f6250-abb1-4c96-8181-5a537b3a1f10 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:03.107747 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-3b5f6250-abb1-4c96-8181-5a537b3a1f10 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:03.117057 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-668cd02e-1d08-4edf-9a22-7b9fd6540064 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:03.118350 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-668cd02e-1d08-4edf-9a22-7b9fd6540064 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:03.118586 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-3b5f6250-abb1-4c96-8181-5a537b3a1f10 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:03.120084 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-3b5f6250-abb1-4c96-8181-5a537b3a1f10 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:03.121203 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-3b5f6250-abb1-4c96-8181-5a537b3a1f10 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1334 microversion: 2.20 time: 0.284251 Jun 01 04:28:03.126886 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-668cd02e-1d08-4edf-9a22-7b9fd6540064 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:03.127409 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-668cd02e-1d08-4edf-9a22-7b9fd6540064 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:03.128190 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-668cd02e-1d08-4edf-9a22-7b9fd6540064 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:03.128663 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-668cd02e-1d08-4edf-9a22-7b9fd6540064 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:03.133028 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 48/91] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:28:02 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1334 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:28:03.247003 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-668cd02e-1d08-4edf-9a22-7b9fd6540064 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:03.256897 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-668cd02e-1d08-4edf-9a22-7b9fd6540064 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1274 microversion: 2.1 time: 0.144749 Jun 01 04:28:03.257475 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 44/92] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:03 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1274 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:03.400590 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-07e9ae9e-6c4c-483b-8e91-8a235faa4741 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:03.401204 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-07e9ae9e-6c4c-483b-8e91-8a235faa4741 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:03.417255 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-07e9ae9e-6c4c-483b-8e91-8a235faa4741 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:03.417611 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-07e9ae9e-6c4c-483b-8e91-8a235faa4741 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:03.418568 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-07e9ae9e-6c4c-483b-8e91-8a235faa4741 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:03.419010 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-07e9ae9e-6c4c-483b-8e91-8a235faa4741 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:03.808684 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-07e9ae9e-6c4c-483b-8e91-8a235faa4741 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:03.818809 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-07e9ae9e-6c4c-483b-8e91-8a235faa4741 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.423049 Jun 01 04:28:03.819761 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 49/93] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:03 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:04.161080 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-1f8d0ee4-d1df-4cbd-8bbe-3baeb879f4e2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:04.161080 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-1f8d0ee4-d1df-4cbd-8bbe-3baeb879f4e2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:04.162177 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-7abb4495-cf66-46b0-b551-796199214712 tempest-VolumesTestJSON-1031630003 tempest-VolumesTestJSON-1031630003-project] Calling method '.version_select at 0x7ff3264ca940>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:04.163081 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1f8d0ee4-d1df-4cbd-8bbe-3baeb879f4e2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:04.163081 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1f8d0ee4-d1df-4cbd-8bbe-3baeb879f4e2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:04.163081 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1f8d0ee4-d1df-4cbd-8bbe-3baeb879f4e2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:04.163081 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1f8d0ee4-d1df-4cbd-8bbe-3baeb879f4e2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:04.215019 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-7abb4495-cf66-46b0-b551-796199214712 tempest-VolumesTestJSON-1031630003 tempest-VolumesTestJSON-1031630003-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/8a7d6219-efbe-4169-9cbf-ceafc7263743" status: 200 len: 351 microversion: 2.1 time: 0.072245 Jun 01 04:28:04.221243 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 50/94] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 1 04:28:04 2022] GET /compute/v2.1/os-volumes/8a7d6219-efbe-4169-9cbf-ceafc7263743 => generated 351 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:28:04.275870 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-cc1d298a-8311-42f9-a32d-c0f104e8e01c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:04.276552 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-cc1d298a-8311-42f9-a32d-c0f104e8e01c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:04.286385 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-cc1d298a-8311-42f9-a32d-c0f104e8e01c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:04.287094 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-cc1d298a-8311-42f9-a32d-c0f104e8e01c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:04.288592 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-cc1d298a-8311-42f9-a32d-c0f104e8e01c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:04.289169 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-cc1d298a-8311-42f9-a32d-c0f104e8e01c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:04.299347 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-1f8d0ee4-d1df-4cbd-8bbe-3baeb879f4e2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:04.344496 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-1f8d0ee4-d1df-4cbd-8bbe-3baeb879f4e2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:04.346296 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-1f8d0ee4-d1df-4cbd-8bbe-3baeb879f4e2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:04.347596 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-1f8d0ee4-d1df-4cbd-8bbe-3baeb879f4e2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1340 microversion: 2.20 time: 0.206552 Jun 01 04:28:04.348278 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 45/95] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:28:04 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1340 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:28:04.402681 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-cc1d298a-8311-42f9-a32d-c0f104e8e01c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:04.421139 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-cc1d298a-8311-42f9-a32d-c0f104e8e01c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1280 microversion: 2.1 time: 0.143175 Jun 01 04:28:04.434014 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 51/96] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:04 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1280 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:04.837962 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-f7be4d46-9cb7-4593-a747-2a836ace80b5 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:04.839000 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-f7be4d46-9cb7-4593-a747-2a836ace80b5 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:04.874097 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f7be4d46-9cb7-4593-a747-2a836ace80b5 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:04.903200 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f7be4d46-9cb7-4593-a747-2a836ace80b5 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:04.905258 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f7be4d46-9cb7-4593-a747-2a836ace80b5 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:04.905991 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f7be4d46-9cb7-4593-a747-2a836ace80b5 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:05.223975 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-f7be4d46-9cb7-4593-a747-2a836ace80b5 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:05.233254 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-f7be4d46-9cb7-4593-a747-2a836ace80b5 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.399724 Jun 01 04:28:05.233851 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 46/97] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:04 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:28:05.366147 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-2ada0e0b-ad78-4576-bffb-ed421f1c8254 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:05.366767 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-2ada0e0b-ad78-4576-bffb-ed421f1c8254 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:05.375000 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2ada0e0b-ad78-4576-bffb-ed421f1c8254 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:05.375552 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2ada0e0b-ad78-4576-bffb-ed421f1c8254 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:05.376480 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2ada0e0b-ad78-4576-bffb-ed421f1c8254 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:05.376920 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2ada0e0b-ad78-4576-bffb-ed421f1c8254 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:05.444587 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d660e0aa-09af-4907-9e51-95466777571d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:05.444587 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-d660e0aa-09af-4907-9e51-95466777571d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:05.453195 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d660e0aa-09af-4907-9e51-95466777571d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:05.453666 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d660e0aa-09af-4907-9e51-95466777571d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:05.454465 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d660e0aa-09af-4907-9e51-95466777571d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:05.454914 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d660e0aa-09af-4907-9e51-95466777571d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:05.574318 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-2ada0e0b-ad78-4576-bffb-ed421f1c8254 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:05.584352 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-2ada0e0b-ad78-4576-bffb-ed421f1c8254 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:05.586095 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-2ada0e0b-ad78-4576-bffb-ed421f1c8254 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:05.587372 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-2ada0e0b-ad78-4576-bffb-ed421f1c8254 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1408 microversion: 2.20 time: 0.225166 Jun 01 04:28:05.599277 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 52/98] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:28:05 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1408 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:28:05.674621 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-d660e0aa-09af-4907-9e51-95466777571d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:05.682279 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-d660e0aa-09af-4907-9e51-95466777571d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1322 microversion: 2.1 time: 0.244258 Jun 01 04:28:05.682788 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 47/99] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:05 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:06.250541 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-b3b3b243-cf32-4322-9d1b-b58093ca82d4 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:06.251153 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-b3b3b243-cf32-4322-9d1b-b58093ca82d4 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:06.264870 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b3b3b243-cf32-4322-9d1b-b58093ca82d4 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:06.265385 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b3b3b243-cf32-4322-9d1b-b58093ca82d4 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:06.266149 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b3b3b243-cf32-4322-9d1b-b58093ca82d4 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:06.266598 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b3b3b243-cf32-4322-9d1b-b58093ca82d4 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:06.394318 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-b3b3b243-cf32-4322-9d1b-b58093ca82d4 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:06.402450 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-b3b3b243-cf32-4322-9d1b-b58093ca82d4 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.156324 Jun 01 04:28:06.403185 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 53/100] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:06 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:06.608475 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-7eab8fc6-f451-488a-91e9-7d3aa1c5f2fa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:06.609228 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-7eab8fc6-f451-488a-91e9-7d3aa1c5f2fa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:06.616030 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7eab8fc6-f451-488a-91e9-7d3aa1c5f2fa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:06.616486 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7eab8fc6-f451-488a-91e9-7d3aa1c5f2fa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:06.617292 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7eab8fc6-f451-488a-91e9-7d3aa1c5f2fa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:06.617734 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7eab8fc6-f451-488a-91e9-7d3aa1c5f2fa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:06.698396 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-5880474a-8dac-45b2-a150-b13e5ed015e7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:06.699104 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-5880474a-8dac-45b2-a150-b13e5ed015e7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:06.705992 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5880474a-8dac-45b2-a150-b13e5ed015e7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:06.706574 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5880474a-8dac-45b2-a150-b13e5ed015e7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:06.707430 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5880474a-8dac-45b2-a150-b13e5ed015e7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:06.707987 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5880474a-8dac-45b2-a150-b13e5ed015e7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:06.800217 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-7eab8fc6-f451-488a-91e9-7d3aa1c5f2fa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:06.809373 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-7eab8fc6-f451-488a-91e9-7d3aa1c5f2fa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:06.811264 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-7eab8fc6-f451-488a-91e9-7d3aa1c5f2fa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:06.812651 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-7eab8fc6-f451-488a-91e9-7d3aa1c5f2fa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1408 microversion: 2.20 time: 0.210466 Jun 01 04:28:06.813293 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 48/101] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:28:06 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1408 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:28:06.931192 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-5880474a-8dac-45b2-a150-b13e5ed015e7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:06.939477 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-5880474a-8dac-45b2-a150-b13e5ed015e7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1322 microversion: 2.1 time: 0.244842 Jun 01 04:28:06.940052 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 54/102] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:06 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:28:07.316468 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-91335a9e-97fa-4d2f-8d2d-901c181b9bac tempest-VolumesTestJSON-1031630003 tempest-VolumesTestJSON-1031630003-project] Calling method '.version_select at 0x7ff325c8ae50>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:07.370085 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-91335a9e-97fa-4d2f-8d2d-901c181b9bac tempest-VolumesTestJSON-1031630003 tempest-VolumesTestJSON-1031630003-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/abbd7078-5cbd-4f13-9017-33d4eb47216b" status: 200 len: 351 microversion: 2.1 time: 0.057196 Jun 01 04:28:07.370824 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 49/103] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 1 04:28:07 2022] GET /compute/v2.1/os-volumes/abbd7078-5cbd-4f13-9017-33d4eb47216b => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:28:07.419492 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-2151641e-e7c9-4f3b-8eaa-f9383d563b07 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:07.420733 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-2151641e-e7c9-4f3b-8eaa-f9383d563b07 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:07.427043 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2151641e-e7c9-4f3b-8eaa-f9383d563b07 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:07.427542 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2151641e-e7c9-4f3b-8eaa-f9383d563b07 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:07.428295 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2151641e-e7c9-4f3b-8eaa-f9383d563b07 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:07.428874 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2151641e-e7c9-4f3b-8eaa-f9383d563b07 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:07.660312 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-2151641e-e7c9-4f3b-8eaa-f9383d563b07 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:07.671473 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-2151641e-e7c9-4f3b-8eaa-f9383d563b07 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.255564 Jun 01 04:28:07.672414 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 55/104] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:07 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:07.831063 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-84b4bf74-0b71-4a04-900d-51ad2e2f0456 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:07.831836 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-84b4bf74-0b71-4a04-900d-51ad2e2f0456 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:07.839494 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-84b4bf74-0b71-4a04-900d-51ad2e2f0456 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:07.840054 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-84b4bf74-0b71-4a04-900d-51ad2e2f0456 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:07.840907 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-84b4bf74-0b71-4a04-900d-51ad2e2f0456 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:07.841490 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-84b4bf74-0b71-4a04-900d-51ad2e2f0456 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:07.957746 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-3d356450-a4b7-43c9-a776-d4f2d909f03f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:07.959685 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-3d356450-a4b7-43c9-a776-d4f2d909f03f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:07.969025 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3d356450-a4b7-43c9-a776-d4f2d909f03f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:07.969733 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3d356450-a4b7-43c9-a776-d4f2d909f03f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:07.970596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3d356450-a4b7-43c9-a776-d4f2d909f03f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:07.971035 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3d356450-a4b7-43c9-a776-d4f2d909f03f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:08.150098 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-3d356450-a4b7-43c9-a776-d4f2d909f03f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:08.159122 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-3d356450-a4b7-43c9-a776-d4f2d909f03f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1322 microversion: 2.1 time: 0.206743 Jun 01 04:28:08.160257 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 56/105] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:07 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:28:08.192890 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-84b4bf74-0b71-4a04-900d-51ad2e2f0456 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:08.207871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-84b4bf74-0b71-4a04-900d-51ad2e2f0456 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:08.209972 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-84b4bf74-0b71-4a04-900d-51ad2e2f0456 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:08.211944 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-84b4bf74-0b71-4a04-900d-51ad2e2f0456 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1408 microversion: 2.20 time: 0.385076 Jun 01 04:28:08.212716 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 50/106] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:28:07 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1408 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:28:08.689616 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-71ea60b7-83ca-4f4f-a131-343278552f23 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:08.690785 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-71ea60b7-83ca-4f4f-a131-343278552f23 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:08.697915 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-71ea60b7-83ca-4f4f-a131-343278552f23 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:08.698365 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-71ea60b7-83ca-4f4f-a131-343278552f23 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:08.699168 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-71ea60b7-83ca-4f4f-a131-343278552f23 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:08.699785 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-71ea60b7-83ca-4f4f-a131-343278552f23 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:08.839008 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-71ea60b7-83ca-4f4f-a131-343278552f23 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:08.845333 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-71ea60b7-83ca-4f4f-a131-343278552f23 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.160004 Jun 01 04:28:08.845873 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 57/107] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:08 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:09.176334 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-aa72ad25-c4bd-4484-ad91-8f4a7b769816 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:09.187955 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-aa72ad25-c4bd-4484-ad91-8f4a7b769816 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:09.187955 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-aa72ad25-c4bd-4484-ad91-8f4a7b769816 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:09.187955 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-aa72ad25-c4bd-4484-ad91-8f4a7b769816 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:09.187955 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-aa72ad25-c4bd-4484-ad91-8f4a7b769816 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:09.188264 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-aa72ad25-c4bd-4484-ad91-8f4a7b769816 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:09.230111 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-e6249bfb-62bc-46c9-b5e5-ec9d5b76afcb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:09.230721 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-e6249bfb-62bc-46c9-b5e5-ec9d5b76afcb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:09.237468 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e6249bfb-62bc-46c9-b5e5-ec9d5b76afcb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:09.237910 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e6249bfb-62bc-46c9-b5e5-ec9d5b76afcb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:09.238670 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e6249bfb-62bc-46c9-b5e5-ec9d5b76afcb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:09.239102 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e6249bfb-62bc-46c9-b5e5-ec9d5b76afcb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:09.322978 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-aa72ad25-c4bd-4484-ad91-8f4a7b769816 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:09.330826 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-aa72ad25-c4bd-4484-ad91-8f4a7b769816 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1322 microversion: 2.1 time: 0.158400 Jun 01 04:28:09.331504 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 51/108] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:09 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:09.380765 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-e6249bfb-62bc-46c9-b5e5-ec9d5b76afcb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:09.388971 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-e6249bfb-62bc-46c9-b5e5-ec9d5b76afcb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:09.390529 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-e6249bfb-62bc-46c9-b5e5-ec9d5b76afcb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:09.392792 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-e6249bfb-62bc-46c9-b5e5-ec9d5b76afcb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1408 microversion: 2.20 time: 0.166795 Jun 01 04:28:09.393601 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 58/109] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:28:09 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:28:09.862448 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-806816a9-7ca3-418b-a204-e17e7df3685e tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:09.862984 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-806816a9-7ca3-418b-a204-e17e7df3685e tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:09.869092 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-806816a9-7ca3-418b-a204-e17e7df3685e tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:09.869554 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-806816a9-7ca3-418b-a204-e17e7df3685e tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:09.870341 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-806816a9-7ca3-418b-a204-e17e7df3685e tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:09.870772 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-806816a9-7ca3-418b-a204-e17e7df3685e tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:10.010225 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-806816a9-7ca3-418b-a204-e17e7df3685e tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:10.014592 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=100 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:10.020235 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-806816a9-7ca3-418b-a204-e17e7df3685e tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.161870 Jun 01 04:28:10.020821 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 52/110] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:09 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:10.348044 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-8dcbb6ce-9fe1-46a3-8005-07f573cd1523 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:10.348643 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-8dcbb6ce-9fe1-46a3-8005-07f573cd1523 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:10.354961 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8dcbb6ce-9fe1-46a3-8005-07f573cd1523 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:10.355430 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8dcbb6ce-9fe1-46a3-8005-07f573cd1523 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:10.356191 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8dcbb6ce-9fe1-46a3-8005-07f573cd1523 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:10.356623 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8dcbb6ce-9fe1-46a3-8005-07f573cd1523 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:10.374327 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=100 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:10.412244 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-971d7464-aebb-4b52-ae09-a3de96ccf374 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:10.412991 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-971d7464-aebb-4b52-ae09-a3de96ccf374 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:10.420308 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-971d7464-aebb-4b52-ae09-a3de96ccf374 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:10.420848 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-971d7464-aebb-4b52-ae09-a3de96ccf374 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:10.421700 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-971d7464-aebb-4b52-ae09-a3de96ccf374 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:10.422309 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-971d7464-aebb-4b52-ae09-a3de96ccf374 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:10.497079 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-8dcbb6ce-9fe1-46a3-8005-07f573cd1523 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:10.505141 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-8dcbb6ce-9fe1-46a3-8005-07f573cd1523 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1322 microversion: 2.1 time: 0.160792 Jun 01 04:28:10.507365 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 59/111] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:10 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:10.557753 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-971d7464-aebb-4b52-ae09-a3de96ccf374 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:10.565679 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-971d7464-aebb-4b52-ae09-a3de96ccf374 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:10.567185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-971d7464-aebb-4b52-ae09-a3de96ccf374 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:10.568306 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-971d7464-aebb-4b52-ae09-a3de96ccf374 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1408 microversion: 2.20 time: 0.160352 Jun 01 04:28:10.568854 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 53/112] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:28:10 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:28:11.036837 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-c84fa1be-11a9-4bb2-8ef3-cc88799c2b71 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:11.037573 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-c84fa1be-11a9-4bb2-8ef3-cc88799c2b71 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:11.043672 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c84fa1be-11a9-4bb2-8ef3-cc88799c2b71 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:11.044214 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c84fa1be-11a9-4bb2-8ef3-cc88799c2b71 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:11.045064 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c84fa1be-11a9-4bb2-8ef3-cc88799c2b71 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:11.045619 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c84fa1be-11a9-4bb2-8ef3-cc88799c2b71 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:11.178650 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-c84fa1be-11a9-4bb2-8ef3-cc88799c2b71 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:11.187131 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-c84fa1be-11a9-4bb2-8ef3-cc88799c2b71 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.153579 Jun 01 04:28:11.190859 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 60/113] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:11 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:11.522170 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-bf09d481-b2cf-4abc-b41b-54833003720e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:11.522703 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-bf09d481-b2cf-4abc-b41b-54833003720e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:11.528910 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bf09d481-b2cf-4abc-b41b-54833003720e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:11.529371 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bf09d481-b2cf-4abc-b41b-54833003720e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:11.530654 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bf09d481-b2cf-4abc-b41b-54833003720e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:11.531093 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bf09d481-b2cf-4abc-b41b-54833003720e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:11.586423 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-5e797419-4c64-4042-af56-206cc18dd605 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:11.587028 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-5e797419-4c64-4042-af56-206cc18dd605 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:11.594211 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5e797419-4c64-4042-af56-206cc18dd605 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:11.594739 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5e797419-4c64-4042-af56-206cc18dd605 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:11.595555 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5e797419-4c64-4042-af56-206cc18dd605 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:11.595989 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5e797419-4c64-4042-af56-206cc18dd605 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:11.673727 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-bf09d481-b2cf-4abc-b41b-54833003720e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:11.681615 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-bf09d481-b2cf-4abc-b41b-54833003720e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1322 microversion: 2.1 time: 0.163436 Jun 01 04:28:11.682199 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 54/114] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:11 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:11.739649 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-5e797419-4c64-4042-af56-206cc18dd605 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:11.752151 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-5e797419-4c64-4042-af56-206cc18dd605 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:11.754428 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-5e797419-4c64-4042-af56-206cc18dd605 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:11.755615 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-5e797419-4c64-4042-af56-206cc18dd605 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1408 microversion: 2.20 time: 0.173059 Jun 01 04:28:11.756164 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 61/115] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:28:11 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:28:12.205953 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-4f208ae4-a4f1-4333-88d2-dde4bff10d78 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:12.206567 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-4f208ae4-a4f1-4333-88d2-dde4bff10d78 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:12.213022 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4f208ae4-a4f1-4333-88d2-dde4bff10d78 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:12.213484 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4f208ae4-a4f1-4333-88d2-dde4bff10d78 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:12.214520 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4f208ae4-a4f1-4333-88d2-dde4bff10d78 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:12.215181 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4f208ae4-a4f1-4333-88d2-dde4bff10d78 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:12.657275 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-4f208ae4-a4f1-4333-88d2-dde4bff10d78 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:12.667389 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-4f208ae4-a4f1-4333-88d2-dde4bff10d78 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.466446 Jun 01 04:28:12.682268 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 55/116] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:12 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:28:12.698795 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a1ff8dd9-70c1-483a-b14c-088eabdbac97 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:12.699657 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-a1ff8dd9-70c1-483a-b14c-088eabdbac97 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:12.709023 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a1ff8dd9-70c1-483a-b14c-088eabdbac97 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:12.709471 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a1ff8dd9-70c1-483a-b14c-088eabdbac97 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:12.710252 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a1ff8dd9-70c1-483a-b14c-088eabdbac97 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:12.710688 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a1ff8dd9-70c1-483a-b14c-088eabdbac97 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:12.774319 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-7e62876d-3b40-44de-a646-b362f0f455ba tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:12.776302 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-7e62876d-3b40-44de-a646-b362f0f455ba tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:12.790264 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7e62876d-3b40-44de-a646-b362f0f455ba tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:12.790713 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7e62876d-3b40-44de-a646-b362f0f455ba tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:12.794008 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7e62876d-3b40-44de-a646-b362f0f455ba tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:12.795166 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7e62876d-3b40-44de-a646-b362f0f455ba tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:13.118033 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-a1ff8dd9-70c1-483a-b14c-088eabdbac97 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:13.130252 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-a1ff8dd9-70c1-483a-b14c-088eabdbac97 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1322 microversion: 2.1 time: 0.435273 Jun 01 04:28:13.139728 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 62/117] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:12 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1322 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:13.315729 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-7e62876d-3b40-44de-a646-b362f0f455ba tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:13.327725 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-7e62876d-3b40-44de-a646-b362f0f455ba tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:13.329493 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-7e62876d-3b40-44de-a646-b362f0f455ba tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:13.331525 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-7e62876d-3b40-44de-a646-b362f0f455ba tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1408 microversion: 2.20 time: 0.561546 Jun 01 04:28:13.332631 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 56/118] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:28:12 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1408 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:28:13.403974 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-943c2638-9dc9-489b-a7e7-fed0082b9e24 req-ceeea59f-e4bf-4314-a753-aa5c318a104b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c961e06b-1b03-4e97-8487-57adba5d5e16", "tag": "690b8ab1-955e-471f-b256-fa4681ea0480"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:28:13.434219 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-943c2638-9dc9-489b-a7e7-fed0082b9e24 req-ceeea59f-e4bf-4314-a753-aa5c318a104b service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:13.434900 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-943c2638-9dc9-489b-a7e7-fed0082b9e24 req-ceeea59f-e4bf-4314-a753-aa5c318a104b service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:13.461746 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-943c2638-9dc9-489b-a7e7-fed0082b9e24 req-ceeea59f-e4bf-4314-a753-aa5c318a104b service nova] Creating event network-changed:690b8ab1-955e-471f-b256-fa4681ea0480 for instance c961e06b-1b03-4e97-8487-57adba5d5e16 on hv-cinder-66710 Jun 01 04:28:13.462523 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-943c2638-9dc9-489b-a7e7-fed0082b9e24 req-ceeea59f-e4bf-4314-a753-aa5c318a104b service nova] Acquired lock "compute-rpcapi-router" {{(pid=118517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 01 04:28:13.464113 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b7cede1f-81eb-49dc-9e2c-c066360a8653 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:13.464708 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b7cede1f-81eb-49dc-9e2c-c066360a8653 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:13.465957 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b7cede1f-81eb-49dc-9e2c-c066360a8653 None None] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:13.471570 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b7cede1f-81eb-49dc-9e2c-c066360a8653 None None] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:13.484692 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.compute.rpcapi [None req-b7cede1f-81eb-49dc-9e2c-c066360a8653 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 01 04:28:13.486218 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b7cede1f-81eb-49dc-9e2c-c066360a8653 None None] Releasing lock "compute-rpcapi-router" {{(pid=118517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 01 04:28:13.526635 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-b7cede1f-81eb-49dc-9e2c-c066360a8653 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138311 Jun 01 04:28:13.528649 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 63/119] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:28:13.550908 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-1d540f1e-a624-4d78-ab77-16f04b6b889b tempest-VolumesTestJSON-1031630003 tempest-VolumesTestJSON-1031630003-project] Calling method '.version_select at 0x7ff328162790>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:13.670709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-1d540f1e-a624-4d78-ab77-16f04b6b889b tempest-VolumesTestJSON-1031630003 tempest-VolumesTestJSON-1031630003-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/d301c8f5-d45f-4034-a85b-9be3388120db" status: 200 len: 351 microversion: 2.1 time: 0.128598 Jun 01 04:28:13.672219 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 57/120] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 1 04:28:13 2022] GET /compute/v2.1/os-volumes/d301c8f5-d45f-4034-a85b-9be3388120db => generated 351 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:28:13.684413 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-f9cdf50d-c221-43e4-9f8d-0a8a1bcc838b tempest-VolumesTestJSON-1031630003 tempest-VolumesTestJSON-1031630003-project] Calling method '.version_select at 0x7ff325cb2c10>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:13.760876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-39d1fa05-4653-49b7-a8d2-5691e5daf780 req-f1f78d15-ca2a-45ec-8c8e-ef1d3276cd55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb2f4fea-bee1-42d9-8db6-985d2f390991", "name": "network-vif-plugged", "status": "completed", "tag": "26362886-e304-4f86-af04-dede6afa3f35"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:28:13.772550 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-39d1fa05-4653-49b7-a8d2-5691e5daf780 req-f1f78d15-ca2a-45ec-8c8e-ef1d3276cd55 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:13.773196 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-39d1fa05-4653-49b7-a8d2-5691e5daf780 req-f1f78d15-ca2a-45ec-8c8e-ef1d3276cd55 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:13.805899 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-39d1fa05-4653-49b7-a8d2-5691e5daf780 req-f1f78d15-ca2a-45ec-8c8e-ef1d3276cd55 service nova] Creating event network-vif-plugged:26362886-e304-4f86-af04-dede6afa3f35 for instance bb2f4fea-bee1-42d9-8db6-985d2f390991 on hv-cinder-66710 Jun 01 04:28:13.813659 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-39d1fa05-4653-49b7-a8d2-5691e5daf780 req-f1f78d15-ca2a-45ec-8c8e-ef1d3276cd55 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215302 Jun 01 04:28:13.814581 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 64/121] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:28:13.823642 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-63bf5795-c7a9-468c-ab8a-e76d31561b6a tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:13.823642 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-63bf5795-c7a9-468c-ab8a-e76d31561b6a tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:13.830087 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-63bf5795-c7a9-468c-ab8a-e76d31561b6a tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:13.831255 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-63bf5795-c7a9-468c-ab8a-e76d31561b6a tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:13.832237 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-63bf5795-c7a9-468c-ab8a-e76d31561b6a tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:13.832822 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-63bf5795-c7a9-468c-ab8a-e76d31561b6a tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:13.959092 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-f9cdf50d-c221-43e4-9f8d-0a8a1bcc838b tempest-VolumesTestJSON-1031630003 tempest-VolumesTestJSON-1031630003-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.279354 Jun 01 04:28:13.959691 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 58/122] 10.222.0.18 () {58 vars in 1133 bytes} [Wed Jun 1 04:28:13 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:28:14.123251 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-5307567a-be48-4bec-8a0b-c446f79b983d req-2f4e7fb6-9f4d-48a0-a9ac-c42a862496ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c4e6883-b6b6-408f-adb7-2b29610a2150", "tag": "6fd6606f-c4cc-4fce-9771-e37ea15a7749"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:28:14.141153 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-5307567a-be48-4bec-8a0b-c446f79b983d req-2f4e7fb6-9f4d-48a0-a9ac-c42a862496ab service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:14.152278 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-5307567a-be48-4bec-8a0b-c446f79b983d req-2f4e7fb6-9f4d-48a0-a9ac-c42a862496ab service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:14.199227 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-5307567a-be48-4bec-8a0b-c446f79b983d req-2f4e7fb6-9f4d-48a0-a9ac-c42a862496ab service nova] Creating event network-changed:6fd6606f-c4cc-4fce-9771-e37ea15a7749 for instance 0c4e6883-b6b6-408f-adb7-2b29610a2150 on hv-cinder-66710 Jun 01 04:28:14.211858 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-5307567a-be48-4bec-8a0b-c446f79b983d req-2f4e7fb6-9f4d-48a0-a9ac-c42a862496ab service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.249035 Jun 01 04:28:14.217474 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 59/123] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:28:14.225100 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-0b4048d9-5b14-48c0-ae23-0ff688a3505c tempest-VolumesTestJSON-1031630003 tempest-VolumesTestJSON-1031630003-project] Calling method '.version_select at 0x7ff325d5d940>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:14.243434 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-63bf5795-c7a9-468c-ab8a-e76d31561b6a tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:14.254068 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-63bf5795-c7a9-468c-ab8a-e76d31561b6a tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.435779 Jun 01 04:28:14.256156 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 65/124] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:13 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:14.271600 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a8d2a674-2a9f-4b7c-832f-6754ad10322f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:14.279538 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-a8d2a674-2a9f-4b7c-832f-6754ad10322f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:14.292756 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a8d2a674-2a9f-4b7c-832f-6754ad10322f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:14.297438 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a8d2a674-2a9f-4b7c-832f-6754ad10322f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:14.302465 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a8d2a674-2a9f-4b7c-832f-6754ad10322f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:14.302913 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a8d2a674-2a9f-4b7c-832f-6754ad10322f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:14.723244 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-a8d2a674-2a9f-4b7c-832f-6754ad10322f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:14.737527 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-a8d2a674-2a9f-4b7c-832f-6754ad10322f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1322 microversion: 2.1 time: 0.470677 Jun 01 04:28:14.739067 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 66/125] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:14 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1322 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:14.744694 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-cb9aff36-9490-4400-abf7-4281f7921ff7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:14.745699 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-cb9aff36-9490-4400-abf7-4281f7921ff7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:14.756805 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-cb9aff36-9490-4400-abf7-4281f7921ff7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:14.757540 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-cb9aff36-9490-4400-abf7-4281f7921ff7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:14.758676 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-cb9aff36-9490-4400-abf7-4281f7921ff7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:14.762707 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-0b4048d9-5b14-48c0-ae23-0ff688a3505c tempest-VolumesTestJSON-1031630003 tempest-VolumesTestJSON-1031630003-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.541466 Jun 01 04:28:14.772367 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 60/126] 10.222.0.18 () {58 vars in 1148 bytes} [Wed Jun 1 04:28:14 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:28:14.780320 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-34f0c2b0-34f2-4785-a6c5-8548d1b628f4 tempest-VolumesTestJSON-1031630003 tempest-VolumesTestJSON-1031630003-project] Calling method '.version_select at 0x7ff325da0790>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:14.780800 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-cb9aff36-9490-4400-abf7-4281f7921ff7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:15.031888 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-cb9aff36-9490-4400-abf7-4281f7921ff7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:15.040022 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-cb9aff36-9490-4400-abf7-4281f7921ff7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:15.041544 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-cb9aff36-9490-4400-abf7-4281f7921ff7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:15.042728 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-cb9aff36-9490-4400-abf7-4281f7921ff7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1408 microversion: 2.20 time: 0.302229 Jun 01 04:28:15.043357 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 67/127] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:28:14 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1408 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:28:15.064419 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-34f0c2b0-34f2-4785-a6c5-8548d1b628f4 tempest-VolumesTestJSON-1031630003 tempest-VolumesTestJSON-1031630003-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.290953 Jun 01 04:28:15.068900 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 61/128] 10.222.0.18 () {58 vars in 1133 bytes} [Wed Jun 1 04:28:14 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:15.079477 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-b2e8a453-eeb4-4d91-8dca-55ac245debb6 tempest-VolumesTestJSON-1031630003 tempest-VolumesTestJSON-1031630003-project] Calling method '.version_select at 0x7ff3264cac10>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:15.272134 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-9dcc4255-b546-4e25-a88f-3c8741f09b39 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:15.273026 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-9dcc4255-b546-4e25-a88f-3c8741f09b39 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:15.281029 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9dcc4255-b546-4e25-a88f-3c8741f09b39 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:15.281484 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9dcc4255-b546-4e25-a88f-3c8741f09b39 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:15.282276 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9dcc4255-b546-4e25-a88f-3c8741f09b39 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:15.282743 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9dcc4255-b546-4e25-a88f-3c8741f09b39 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:15.419861 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-9dcc4255-b546-4e25-a88f-3c8741f09b39 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:15.429885 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-9dcc4255-b546-4e25-a88f-3c8741f09b39 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.161757 Jun 01 04:28:15.430616 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 62/129] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:15 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:28:15.629356 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-b2e8a453-eeb4-4d91-8dca-55ac245debb6 tempest-VolumesTestJSON-1031630003 tempest-VolumesTestJSON-1031630003-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.551944 Jun 01 04:28:15.629356 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 68/130] 10.222.0.18 () {58 vars in 1166 bytes} [Wed Jun 1 04:28:15 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:28:15.641567 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-909e6e61-807e-423e-b2be-cbc57f432b7a tempest-VolumesTestJSON-1031630003 tempest-VolumesTestJSON-1031630003-project] Calling method '.version_select at 0x7ff328034b80>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:15.756772 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-513cc675-1e84-4f4d-9fe3-daf8d0fd872b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:15.757376 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-513cc675-1e84-4f4d-9fe3-daf8d0fd872b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:15.766942 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-909e6e61-807e-423e-b2be-cbc57f432b7a tempest-VolumesTestJSON-1031630003 tempest-VolumesTestJSON-1031630003-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.126608 Jun 01 04:28:15.776050 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-513cc675-1e84-4f4d-9fe3-daf8d0fd872b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:15.781341 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-513cc675-1e84-4f4d-9fe3-daf8d0fd872b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:15.781341 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-513cc675-1e84-4f4d-9fe3-daf8d0fd872b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:15.781341 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-513cc675-1e84-4f4d-9fe3-daf8d0fd872b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:15.782450 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 63/131] 10.222.0.18 () {58 vars in 1169 bytes} [Wed Jun 1 04:28:15 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:28:15.787473 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-1e4ea549-facd-4678-b9fb-2232ba59a847 tempest-VolumesTestJSON-1031630003 tempest-VolumesTestJSON-1031630003-project] Calling method '.version_select at 0x7ff325d425e0>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:15.875622 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-1e4ea549-facd-4678-b9fb-2232ba59a847 tempest-VolumesTestJSON-1031630003 tempest-VolumesTestJSON-1031630003-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.091847 Jun 01 04:28:15.876238 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 64/132] 10.222.0.18 () {58 vars in 1154 bytes} [Wed Jun 1 04:28:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:15.887181 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-01fc6d28-d472-4860-92a8-db4716ff2162 tempest-VolumesTestJSON-1031630003 tempest-VolumesTestJSON-1031630003-project] Calling method '.version_select at 0x7ff325d5daf0>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:15.929351 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-513cc675-1e84-4f4d-9fe3-daf8d0fd872b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:15.936863 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-513cc675-1e84-4f4d-9fe3-daf8d0fd872b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1322 microversion: 2.1 time: 0.184902 Jun 01 04:28:15.937477 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 69/133] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:15 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:15.971367 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-01fc6d28-d472-4860-92a8-db4716ff2162 tempest-VolumesTestJSON-1031630003 tempest-VolumesTestJSON-1031630003-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087821 Jun 01 04:28:15.971935 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 65/134] 10.222.0.18 () {58 vars in 1187 bytes} [Wed Jun 1 04:28:15 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:28:15.985240 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-9152e329-b010-45ed-82c0-461ebfbe8522 tempest-VolumesTestJSON-1031630003 tempest-VolumesTestJSON-1031630003-project] Calling method '.version_select at 0x7ff3264ac550>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:16.063128 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-df40bea4-264b-42cd-add5-1fc5e69cfd29 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:16.063978 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-df40bea4-264b-42cd-add5-1fc5e69cfd29 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:16.067835 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-9152e329-b010-45ed-82c0-461ebfbe8522 tempest-VolumesTestJSON-1031630003 tempest-VolumesTestJSON-1031630003-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.086739 Jun 01 04:28:16.068605 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 70/135] 10.222.0.18 () {58 vars in 1154 bytes} [Wed Jun 1 04:28:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:16.074984 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-df40bea4-264b-42cd-add5-1fc5e69cfd29 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:16.074984 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-df40bea4-264b-42cd-add5-1fc5e69cfd29 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:16.075816 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-df40bea4-264b-42cd-add5-1fc5e69cfd29 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:16.076250 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-df40bea4-264b-42cd-add5-1fc5e69cfd29 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:16.206437 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-df40bea4-264b-42cd-add5-1fc5e69cfd29 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:16.214612 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-df40bea4-264b-42cd-add5-1fc5e69cfd29 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:16.216176 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-df40bea4-264b-42cd-add5-1fc5e69cfd29 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:16.217425 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-df40bea4-264b-42cd-add5-1fc5e69cfd29 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1408 microversion: 2.20 time: 0.160338 Jun 01 04:28:16.218522 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 66/136] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:28:16 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:28:16.272400 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-a3caeba4-fe15-47c8-9b6a-0ac1420a3bab req-9946682e-e0f4-4298-8d15-a25dd453786e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b5c9f1-ba93-4279-91f7-048a6923868d", "tag": "2e88e076-e176-494f-8401-4e2c11b64a89"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:28:16.281933 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-a3caeba4-fe15-47c8-9b6a-0ac1420a3bab req-9946682e-e0f4-4298-8d15-a25dd453786e service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:16.282370 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-a3caeba4-fe15-47c8-9b6a-0ac1420a3bab req-9946682e-e0f4-4298-8d15-a25dd453786e service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:16.297449 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-a3caeba4-fe15-47c8-9b6a-0ac1420a3bab req-9946682e-e0f4-4298-8d15-a25dd453786e service nova] Creating event network-changed:2e88e076-e176-494f-8401-4e2c11b64a89 for instance d4b5c9f1-ba93-4279-91f7-048a6923868d on hv-cinder-66710 Jun 01 04:28:16.302971 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-a3caeba4-fe15-47c8-9b6a-0ac1420a3bab req-9946682e-e0f4-4298-8d15-a25dd453786e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034167 Jun 01 04:28:16.303597 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 71/137] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:28:16.446709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-188b02ed-e2ff-4e25-b7f8-f533eebea592 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:16.447322 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-188b02ed-e2ff-4e25-b7f8-f533eebea592 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:16.453954 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-188b02ed-e2ff-4e25-b7f8-f533eebea592 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:16.454339 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-188b02ed-e2ff-4e25-b7f8-f533eebea592 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:16.455096 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-188b02ed-e2ff-4e25-b7f8-f533eebea592 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:16.455586 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-188b02ed-e2ff-4e25-b7f8-f533eebea592 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:16.584874 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-188b02ed-e2ff-4e25-b7f8-f533eebea592 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:16.591956 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-188b02ed-e2ff-4e25-b7f8-f533eebea592 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.149160 Jun 01 04:28:16.592521 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 67/138] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:16 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:16.953490 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-e8d8199d-e760-46f8-83c5-860654c40841 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:16.954284 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-e8d8199d-e760-46f8-83c5-860654c40841 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:16.960523 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e8d8199d-e760-46f8-83c5-860654c40841 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:16.961007 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e8d8199d-e760-46f8-83c5-860654c40841 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:16.961853 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e8d8199d-e760-46f8-83c5-860654c40841 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:16.962282 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e8d8199d-e760-46f8-83c5-860654c40841 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:17.096409 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-e8d8199d-e760-46f8-83c5-860654c40841 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:17.104657 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-e8d8199d-e760-46f8-83c5-860654c40841 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1322 microversion: 2.1 time: 0.155449 Jun 01 04:28:17.105219 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 72/139] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:16 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:17.235128 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-a84bb6c4-730c-4af8-b017-d4dae4a63aa3 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:17.235803 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-a84bb6c4-730c-4af8-b017-d4dae4a63aa3 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:17.241907 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a84bb6c4-730c-4af8-b017-d4dae4a63aa3 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:17.242362 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a84bb6c4-730c-4af8-b017-d4dae4a63aa3 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:17.243128 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a84bb6c4-730c-4af8-b017-d4dae4a63aa3 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:17.243607 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a84bb6c4-730c-4af8-b017-d4dae4a63aa3 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:17.372886 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-a84bb6c4-730c-4af8-b017-d4dae4a63aa3 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:17.380974 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-a84bb6c4-730c-4af8-b017-d4dae4a63aa3 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:17.382489 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-a84bb6c4-730c-4af8-b017-d4dae4a63aa3 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:17.383610 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-a84bb6c4-730c-4af8-b017-d4dae4a63aa3 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1408 microversion: 2.20 time: 0.152663 Jun 01 04:28:17.384153 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 68/140] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:28:17 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:28:17.610365 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-736758be-1e27-4e5f-b337-fde634703429 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:17.610976 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-736758be-1e27-4e5f-b337-fde634703429 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:17.617455 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-736758be-1e27-4e5f-b337-fde634703429 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:17.617905 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-736758be-1e27-4e5f-b337-fde634703429 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:17.618709 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-736758be-1e27-4e5f-b337-fde634703429 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:17.619146 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-736758be-1e27-4e5f-b337-fde634703429 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:17.746864 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-736758be-1e27-4e5f-b337-fde634703429 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:17.756703 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-736758be-1e27-4e5f-b337-fde634703429 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.149516 Jun 01 04:28:17.756703 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 73/141] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:17 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:18.122236 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d9cf5fba-1bab-4a34-b314-bef4f4bc3bf5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:18.122845 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-d9cf5fba-1bab-4a34-b314-bef4f4bc3bf5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:18.129604 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d9cf5fba-1bab-4a34-b314-bef4f4bc3bf5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:18.130055 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d9cf5fba-1bab-4a34-b314-bef4f4bc3bf5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:18.130865 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d9cf5fba-1bab-4a34-b314-bef4f4bc3bf5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:18.131256 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d9cf5fba-1bab-4a34-b314-bef4f4bc3bf5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:18.258455 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-d9cf5fba-1bab-4a34-b314-bef4f4bc3bf5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:18.266773 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-d9cf5fba-1bab-4a34-b314-bef4f4bc3bf5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1322 microversion: 2.1 time: 0.147557 Jun 01 04:28:18.266773 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 69/142] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:18 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:18.401877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-171d14f6-d893-4e79-b866-9ffad32841f9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:18.402505 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-171d14f6-d893-4e79-b866-9ffad32841f9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:18.408876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-171d14f6-d893-4e79-b866-9ffad32841f9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:18.409316 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-171d14f6-d893-4e79-b866-9ffad32841f9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:18.410067 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-171d14f6-d893-4e79-b866-9ffad32841f9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:18.410491 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-171d14f6-d893-4e79-b866-9ffad32841f9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:18.538426 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-171d14f6-d893-4e79-b866-9ffad32841f9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:18.546984 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-171d14f6-d893-4e79-b866-9ffad32841f9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:18.548536 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-171d14f6-d893-4e79-b866-9ffad32841f9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:18.549623 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-171d14f6-d893-4e79-b866-9ffad32841f9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1408 microversion: 2.20 time: 0.151710 Jun 01 04:28:18.550180 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 74/143] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:28:18 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:28:18.771727 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-e548b927-6c43-4c1b-8529-e158a634c2f7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:18.772254 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-e548b927-6c43-4c1b-8529-e158a634c2f7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:18.778243 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e548b927-6c43-4c1b-8529-e158a634c2f7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:18.778689 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e548b927-6c43-4c1b-8529-e158a634c2f7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:18.779477 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e548b927-6c43-4c1b-8529-e158a634c2f7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:18.779915 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e548b927-6c43-4c1b-8529-e158a634c2f7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:18.913034 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-e548b927-6c43-4c1b-8529-e158a634c2f7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:18.920489 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-e548b927-6c43-4c1b-8529-e158a634c2f7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.152628 Jun 01 04:28:18.921049 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 70/144] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:18 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:19.282171 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-9d58c6fe-84cf-4e31-90d0-339727270724 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:19.282781 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-9d58c6fe-84cf-4e31-90d0-339727270724 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:19.289428 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9d58c6fe-84cf-4e31-90d0-339727270724 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:19.290166 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9d58c6fe-84cf-4e31-90d0-339727270724 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:19.291080 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9d58c6fe-84cf-4e31-90d0-339727270724 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:19.300244 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9d58c6fe-84cf-4e31-90d0-339727270724 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:19.418780 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-9d58c6fe-84cf-4e31-90d0-339727270724 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:19.426211 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-9d58c6fe-84cf-4e31-90d0-339727270724 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1322 microversion: 2.1 time: 0.148304 Jun 01 04:28:19.426763 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 75/145] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:19 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:19.566786 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-1c60c8e1-916c-4722-aeb3-280966c7c9f9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:19.567510 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-1c60c8e1-916c-4722-aeb3-280966c7c9f9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:19.573645 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1c60c8e1-916c-4722-aeb3-280966c7c9f9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:19.574092 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1c60c8e1-916c-4722-aeb3-280966c7c9f9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:19.574850 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1c60c8e1-916c-4722-aeb3-280966c7c9f9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:19.575281 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1c60c8e1-916c-4722-aeb3-280966c7c9f9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:19.704705 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-1c60c8e1-916c-4722-aeb3-280966c7c9f9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:19.712672 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-1c60c8e1-916c-4722-aeb3-280966c7c9f9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:19.714198 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-1c60c8e1-916c-4722-aeb3-280966c7c9f9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:19.715322 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-1c60c8e1-916c-4722-aeb3-280966c7c9f9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1408 microversion: 2.20 time: 0.152507 Jun 01 04:28:19.715885 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 71/146] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:28:19 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:28:19.937776 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-adab14ae-5b87-46c9-bc67-dfe155d5af8e tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:19.938377 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-adab14ae-5b87-46c9-bc67-dfe155d5af8e tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:19.944464 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-adab14ae-5b87-46c9-bc67-dfe155d5af8e tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:19.945008 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-adab14ae-5b87-46c9-bc67-dfe155d5af8e tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:19.945762 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-adab14ae-5b87-46c9-bc67-dfe155d5af8e tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:19.946189 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-adab14ae-5b87-46c9-bc67-dfe155d5af8e tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:20.078201 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-adab14ae-5b87-46c9-bc67-dfe155d5af8e tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:20.085611 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-adab14ae-5b87-46c9-bc67-dfe155d5af8e tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.152407 Jun 01 04:28:20.086173 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 76/147] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:19 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:20.442499 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-38d6b1ee-4669-4e4a-81c5-ead9177e3a15 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:20.443133 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-38d6b1ee-4669-4e4a-81c5-ead9177e3a15 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:20.449282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-38d6b1ee-4669-4e4a-81c5-ead9177e3a15 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:20.449735 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-38d6b1ee-4669-4e4a-81c5-ead9177e3a15 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:20.450496 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-38d6b1ee-4669-4e4a-81c5-ead9177e3a15 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:20.450931 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-38d6b1ee-4669-4e4a-81c5-ead9177e3a15 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:20.581512 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-38d6b1ee-4669-4e4a-81c5-ead9177e3a15 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:20.588965 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-38d6b1ee-4669-4e4a-81c5-ead9177e3a15 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1322 microversion: 2.1 time: 0.150335 Jun 01 04:28:20.589531 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 72/148] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:20 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:20.733189 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-eba82124-8aee-42ac-b13f-ad3a9c82b83e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:20.733935 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-eba82124-8aee-42ac-b13f-ad3a9c82b83e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:20.740187 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-eba82124-8aee-42ac-b13f-ad3a9c82b83e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:20.740807 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-eba82124-8aee-42ac-b13f-ad3a9c82b83e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:20.744318 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-eba82124-8aee-42ac-b13f-ad3a9c82b83e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:20.744318 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-eba82124-8aee-42ac-b13f-ad3a9c82b83e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:20.884487 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-eba82124-8aee-42ac-b13f-ad3a9c82b83e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:20.892288 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-eba82124-8aee-42ac-b13f-ad3a9c82b83e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:20.893796 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-eba82124-8aee-42ac-b13f-ad3a9c82b83e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:20.894877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-eba82124-8aee-42ac-b13f-ad3a9c82b83e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1408 microversion: 2.20 time: 0.165823 Jun 01 04:28:20.895491 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 77/149] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:28:20 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:28:21.102341 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-42992ee5-6111-451e-b0df-5241a6f79808 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:21.102901 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-42992ee5-6111-451e-b0df-5241a6f79808 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:21.110058 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-42992ee5-6111-451e-b0df-5241a6f79808 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:21.110508 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-42992ee5-6111-451e-b0df-5241a6f79808 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:21.111276 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-42992ee5-6111-451e-b0df-5241a6f79808 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:21.111751 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-42992ee5-6111-451e-b0df-5241a6f79808 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:21.247412 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-42992ee5-6111-451e-b0df-5241a6f79808 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:21.255023 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-42992ee5-6111-451e-b0df-5241a6f79808 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.156769 Jun 01 04:28:21.255714 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 73/150] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:21 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:28:21.606016 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-b5843d2a-840c-4629-9228-41397f5ca360 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:21.606723 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-b5843d2a-840c-4629-9228-41397f5ca360 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:21.613252 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b5843d2a-840c-4629-9228-41397f5ca360 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:21.613997 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b5843d2a-840c-4629-9228-41397f5ca360 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:21.614509 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b5843d2a-840c-4629-9228-41397f5ca360 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:21.614954 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b5843d2a-840c-4629-9228-41397f5ca360 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:21.905277 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-b5843d2a-840c-4629-9228-41397f5ca360 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:21.918294 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-b5843d2a-840c-4629-9228-41397f5ca360 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1322 microversion: 2.1 time: 0.315865 Jun 01 04:28:21.918483 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-c03fbb24-94ea-4492-8baf-bd6148c00f09 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:21.919139 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-c03fbb24-94ea-4492-8baf-bd6148c00f09 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:21.926679 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c03fbb24-94ea-4492-8baf-bd6148c00f09 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:21.927372 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c03fbb24-94ea-4492-8baf-bd6148c00f09 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:21.928314 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c03fbb24-94ea-4492-8baf-bd6148c00f09 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:21.929059 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c03fbb24-94ea-4492-8baf-bd6148c00f09 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:21.930022 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 78/151] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:21 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:22.072684 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-c03fbb24-94ea-4492-8baf-bd6148c00f09 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:22.084263 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-c03fbb24-94ea-4492-8baf-bd6148c00f09 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:22.085787 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-c03fbb24-94ea-4492-8baf-bd6148c00f09 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:22.086951 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-c03fbb24-94ea-4492-8baf-bd6148c00f09 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1408 microversion: 2.20 time: 0.177651 Jun 01 04:28:22.087661 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 74/152] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:28:21 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:28:22.273180 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-8fd782fd-7a46-45f9-95e3-3f3c69c896ed tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:22.273848 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-8fd782fd-7a46-45f9-95e3-3f3c69c896ed tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:22.280596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8fd782fd-7a46-45f9-95e3-3f3c69c896ed tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:22.281061 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8fd782fd-7a46-45f9-95e3-3f3c69c896ed tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:22.281826 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8fd782fd-7a46-45f9-95e3-3f3c69c896ed tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:22.282258 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8fd782fd-7a46-45f9-95e3-3f3c69c896ed tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:22.414490 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-8fd782fd-7a46-45f9-95e3-3f3c69c896ed tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:22.418141 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=100 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:22.423900 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-8fd782fd-7a46-45f9-95e3-3f3c69c896ed tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.155305 Jun 01 04:28:22.424461 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 79/153] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:22 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:28:22.940054 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-9c07208d-24f8-491a-8bfb-5b4504b668ef tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:22.941204 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-9c07208d-24f8-491a-8bfb-5b4504b668ef tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:22.951712 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9c07208d-24f8-491a-8bfb-5b4504b668ef tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:22.952529 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9c07208d-24f8-491a-8bfb-5b4504b668ef tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:22.953932 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9c07208d-24f8-491a-8bfb-5b4504b668ef tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:22.954868 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9c07208d-24f8-491a-8bfb-5b4504b668ef tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:23.105889 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-00d93734-0be1-4ef5-80ca-54453c99e615 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:23.106488 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-00d93734-0be1-4ef5-80ca-54453c99e615 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:23.113521 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-00d93734-0be1-4ef5-80ca-54453c99e615 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:23.113967 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-00d93734-0be1-4ef5-80ca-54453c99e615 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:23.114730 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-00d93734-0be1-4ef5-80ca-54453c99e615 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:23.115164 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-00d93734-0be1-4ef5-80ca-54453c99e615 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:23.152218 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-9c07208d-24f8-491a-8bfb-5b4504b668ef tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:23.164167 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-9c07208d-24f8-491a-8bfb-5b4504b668ef tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1322 microversion: 2.1 time: 0.230700 Jun 01 04:28:23.165619 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 75/154] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:22 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:23.274940 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-00d93734-0be1-4ef5-80ca-54453c99e615 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:23.283462 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-00d93734-0be1-4ef5-80ca-54453c99e615 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:23.284976 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-00d93734-0be1-4ef5-80ca-54453c99e615 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:23.286242 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-00d93734-0be1-4ef5-80ca-54453c99e615 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1408 microversion: 2.20 time: 0.184162 Jun 01 04:28:23.286803 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 80/155] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:28:23 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:28:23.442025 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-e1c8f805-f47d-4c87-9dd4-cbabcb24a0e7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:23.442596 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-e1c8f805-f47d-4c87-9dd4-cbabcb24a0e7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:23.448612 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e1c8f805-f47d-4c87-9dd4-cbabcb24a0e7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:23.449066 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e1c8f805-f47d-4c87-9dd4-cbabcb24a0e7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:23.449875 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e1c8f805-f47d-4c87-9dd4-cbabcb24a0e7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:23.450313 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e1c8f805-f47d-4c87-9dd4-cbabcb24a0e7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:23.750254 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-e1c8f805-f47d-4c87-9dd4-cbabcb24a0e7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:23.759542 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-e1c8f805-f47d-4c87-9dd4-cbabcb24a0e7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.322187 Jun 01 04:28:23.763882 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 76/156] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:23 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:24.182149 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-59983f0c-87f2-4b96-aa93-8aedfb24e402 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:24.182758 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-59983f0c-87f2-4b96-aa93-8aedfb24e402 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:24.184599 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell0:SELECT=2 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:24.190174 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-59983f0c-87f2-4b96-aa93-8aedfb24e402 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:24.190625 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-59983f0c-87f2-4b96-aa93-8aedfb24e402 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:24.191430 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-59983f0c-87f2-4b96-aa93-8aedfb24e402 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:24.194406 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-59983f0c-87f2-4b96-aa93-8aedfb24e402 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:24.304149 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-cf6f85f0-6c2f-4ab8-9697-5a196687b226 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:24.304870 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-cf6f85f0-6c2f-4ab8-9697-5a196687b226 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:24.311524 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cf6f85f0-6c2f-4ab8-9697-5a196687b226 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:24.312205 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cf6f85f0-6c2f-4ab8-9697-5a196687b226 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:24.313174 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cf6f85f0-6c2f-4ab8-9697-5a196687b226 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:24.313718 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cf6f85f0-6c2f-4ab8-9697-5a196687b226 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:24.318295 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=100 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:24.328259 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-59983f0c-87f2-4b96-aa93-8aedfb24e402 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:24.337749 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-59983f0c-87f2-4b96-aa93-8aedfb24e402 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1322 microversion: 2.1 time: 0.159309 Jun 01 04:28:24.341274 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 81/157] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:24 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:24.458873 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-cf6f85f0-6c2f-4ab8-9697-5a196687b226 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:24.467403 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-cf6f85f0-6c2f-4ab8-9697-5a196687b226 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:24.469495 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-cf6f85f0-6c2f-4ab8-9697-5a196687b226 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:24.470635 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-cf6f85f0-6c2f-4ab8-9697-5a196687b226 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1408 microversion: 2.20 time: 0.170605 Jun 01 04:28:24.471199 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 77/158] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:28:24 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:28:24.777765 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-5ddb578e-a135-4b05-9f31-192a817ce40a tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:24.778280 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-5ddb578e-a135-4b05-9f31-192a817ce40a tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:24.785269 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5ddb578e-a135-4b05-9f31-192a817ce40a tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:24.785720 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5ddb578e-a135-4b05-9f31-192a817ce40a tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:24.786481 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5ddb578e-a135-4b05-9f31-192a817ce40a tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:24.787012 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5ddb578e-a135-4b05-9f31-192a817ce40a tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:24.922196 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-5ddb578e-a135-4b05-9f31-192a817ce40a tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:24.931014 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-5ddb578e-a135-4b05-9f31-192a817ce40a tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.155702 Jun 01 04:28:24.931014 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 82/159] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:24 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:25.355769 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-3ae294b9-4170-4dc0-85ee-1c2b2c9fb599 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:25.356529 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-3ae294b9-4170-4dc0-85ee-1c2b2c9fb599 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:25.363568 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3ae294b9-4170-4dc0-85ee-1c2b2c9fb599 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:25.364300 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3ae294b9-4170-4dc0-85ee-1c2b2c9fb599 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:25.365075 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3ae294b9-4170-4dc0-85ee-1c2b2c9fb599 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:25.365675 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3ae294b9-4170-4dc0-85ee-1c2b2c9fb599 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:25.488460 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-f7feee77-2d18-4f86-8fe0-452cb20a5850 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:25.489094 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-f7feee77-2d18-4f86-8fe0-452cb20a5850 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:25.494967 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-3ae294b9-4170-4dc0-85ee-1c2b2c9fb599 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:25.495363 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f7feee77-2d18-4f86-8fe0-452cb20a5850 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:25.495816 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f7feee77-2d18-4f86-8fe0-452cb20a5850 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:25.496584 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f7feee77-2d18-4f86-8fe0-452cb20a5850 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:25.497017 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f7feee77-2d18-4f86-8fe0-452cb20a5850 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:25.503385 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-3ae294b9-4170-4dc0-85ee-1c2b2c9fb599 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1322 microversion: 2.1 time: 0.152075 Jun 01 04:28:25.503965 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 78/160] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:25 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:25.632824 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-f7feee77-2d18-4f86-8fe0-452cb20a5850 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:25.641172 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-f7feee77-2d18-4f86-8fe0-452cb20a5850 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:25.642675 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-f7feee77-2d18-4f86-8fe0-452cb20a5850 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:25.643809 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-f7feee77-2d18-4f86-8fe0-452cb20a5850 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1408 microversion: 2.20 time: 0.159731 Jun 01 04:28:25.644417 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 83/161] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:28:25 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:28:25.949719 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-4fb48f65-fee4-4298-afb7-3cf4db4ff4ba tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:25.950345 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-4fb48f65-fee4-4298-afb7-3cf4db4ff4ba tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:25.956263 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4fb48f65-fee4-4298-afb7-3cf4db4ff4ba tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:25.956710 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4fb48f65-fee4-4298-afb7-3cf4db4ff4ba tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:25.957465 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4fb48f65-fee4-4298-afb7-3cf4db4ff4ba tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:25.958051 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4fb48f65-fee4-4298-afb7-3cf4db4ff4ba tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:26.091920 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-4fb48f65-fee4-4298-afb7-3cf4db4ff4ba tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:26.099905 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-4fb48f65-fee4-4298-afb7-3cf4db4ff4ba tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.154000 Jun 01 04:28:26.100463 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 79/162] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:25 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:26.519777 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-1fdacd33-8e50-4ee5-a6f6-f15617f53e83 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:26.520308 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-1fdacd33-8e50-4ee5-a6f6-f15617f53e83 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:26.526246 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1fdacd33-8e50-4ee5-a6f6-f15617f53e83 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:26.526692 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1fdacd33-8e50-4ee5-a6f6-f15617f53e83 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:26.527529 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1fdacd33-8e50-4ee5-a6f6-f15617f53e83 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:26.527918 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1fdacd33-8e50-4ee5-a6f6-f15617f53e83 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:26.659320 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-1fdacd33-8e50-4ee5-a6f6-f15617f53e83 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:26.661572 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-e317dc09-d3b7-4055-8691-cc59ace288ad tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:26.662188 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-e317dc09-d3b7-4055-8691-cc59ace288ad tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:26.668352 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e317dc09-d3b7-4055-8691-cc59ace288ad tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:26.668610 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-1fdacd33-8e50-4ee5-a6f6-f15617f53e83 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1322 microversion: 2.1 time: 0.153279 Jun 01 04:28:26.668987 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e317dc09-d3b7-4055-8691-cc59ace288ad tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:26.677874 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 84/163] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:26 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:26.681981 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e317dc09-d3b7-4055-8691-cc59ace288ad tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:26.681981 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e317dc09-d3b7-4055-8691-cc59ace288ad tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:26.802461 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-e317dc09-d3b7-4055-8691-cc59ace288ad tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:26.810305 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-e317dc09-d3b7-4055-8691-cc59ace288ad tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:26.811859 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-e317dc09-d3b7-4055-8691-cc59ace288ad tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:26.813640 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-e317dc09-d3b7-4055-8691-cc59ace288ad tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1408 microversion: 2.20 time: 0.155969 Jun 01 04:28:26.814194 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 80/164] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:28:26 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:28:27.117036 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-28110bc1-6373-4414-b9a7-3849b26c28fc tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:27.117549 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-28110bc1-6373-4414-b9a7-3849b26c28fc tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:27.123547 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-28110bc1-6373-4414-b9a7-3849b26c28fc tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:27.123989 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-28110bc1-6373-4414-b9a7-3849b26c28fc tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:27.125612 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-28110bc1-6373-4414-b9a7-3849b26c28fc tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:27.126050 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-28110bc1-6373-4414-b9a7-3849b26c28fc tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:27.253989 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-28110bc1-6373-4414-b9a7-3849b26c28fc tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:27.261485 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-28110bc1-6373-4414-b9a7-3849b26c28fc tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.148487 Jun 01 04:28:27.262107 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 85/165] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:27 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:27.685831 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-00c3d9fd-4049-40cc-a657-d2a668f009cf tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:27.686441 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-00c3d9fd-4049-40cc-a657-d2a668f009cf tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:27.699255 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-00c3d9fd-4049-40cc-a657-d2a668f009cf tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:27.699255 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-00c3d9fd-4049-40cc-a657-d2a668f009cf tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:27.699255 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-00c3d9fd-4049-40cc-a657-d2a668f009cf tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:27.699255 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-00c3d9fd-4049-40cc-a657-d2a668f009cf tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:27.823255 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-00c3d9fd-4049-40cc-a657-d2a668f009cf tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:27.833323 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-f487841c-a7ee-4d06-8508-660309f9e94a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:27.833823 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-00c3d9fd-4049-40cc-a657-d2a668f009cf tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1322 microversion: 2.1 time: 0.151935 Jun 01 04:28:27.834098 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-f487841c-a7ee-4d06-8508-660309f9e94a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:27.834344 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 81/166] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:27 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:27.840850 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f487841c-a7ee-4d06-8508-660309f9e94a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:27.841412 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f487841c-a7ee-4d06-8508-660309f9e94a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:27.842308 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f487841c-a7ee-4d06-8508-660309f9e94a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:27.842800 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f487841c-a7ee-4d06-8508-660309f9e94a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:27.977914 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-f487841c-a7ee-4d06-8508-660309f9e94a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:27.986123 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-f487841c-a7ee-4d06-8508-660309f9e94a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:27.987692 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-f487841c-a7ee-4d06-8508-660309f9e94a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:27.988778 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-f487841c-a7ee-4d06-8508-660309f9e94a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1408 microversion: 2.20 time: 0.161838 Jun 01 04:28:27.989330 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 86/167] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:28:27 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:28:28.278336 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-e84e7dc9-a30b-4cf1-ad13-2d920e9c896d tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:28.278954 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-e84e7dc9-a30b-4cf1-ad13-2d920e9c896d tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:28.285627 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e84e7dc9-a30b-4cf1-ad13-2d920e9c896d tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:28.286071 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e84e7dc9-a30b-4cf1-ad13-2d920e9c896d tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:28.286896 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e84e7dc9-a30b-4cf1-ad13-2d920e9c896d tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:28.287365 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e84e7dc9-a30b-4cf1-ad13-2d920e9c896d tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:28.421145 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-e84e7dc9-a30b-4cf1-ad13-2d920e9c896d tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:28.429226 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-e84e7dc9-a30b-4cf1-ad13-2d920e9c896d tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.154890 Jun 01 04:28:28.429791 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 82/168] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:28 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:28.850663 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-7d327e10-86e8-4d8f-b49c-1f244233c913 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:28.851559 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-7d327e10-86e8-4d8f-b49c-1f244233c913 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:28.856762 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_api:SELECT=88 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:28.859207 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7d327e10-86e8-4d8f-b49c-1f244233c913 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:28.859675 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7d327e10-86e8-4d8f-b49c-1f244233c913 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:28.861115 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7d327e10-86e8-4d8f-b49c-1f244233c913 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:28.861675 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7d327e10-86e8-4d8f-b49c-1f244233c913 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:28.994238 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-7d327e10-86e8-4d8f-b49c-1f244233c913 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:29.001933 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-7d327e10-86e8-4d8f-b49c-1f244233c913 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1322 microversion: 2.1 time: 0.155060 Jun 01 04:28:29.003456 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 87/169] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:28 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:29.006199 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-702dc629-603c-4e5b-9bb7-6dc9f270d7ea tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:29.007172 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-702dc629-603c-4e5b-9bb7-6dc9f270d7ea tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:29.009416 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_api:SELECT=78 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:29.014454 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-702dc629-603c-4e5b-9bb7-6dc9f270d7ea tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:29.014900 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-702dc629-603c-4e5b-9bb7-6dc9f270d7ea tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:29.015712 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-702dc629-603c-4e5b-9bb7-6dc9f270d7ea tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:29.016146 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-702dc629-603c-4e5b-9bb7-6dc9f270d7ea tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:29.148650 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-702dc629-603c-4e5b-9bb7-6dc9f270d7ea tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:29.157270 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-702dc629-603c-4e5b-9bb7-6dc9f270d7ea tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:29.159036 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-702dc629-603c-4e5b-9bb7-6dc9f270d7ea tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:29.160165 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-702dc629-603c-4e5b-9bb7-6dc9f270d7ea tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1408 microversion: 2.20 time: 0.158094 Jun 01 04:28:29.160714 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 83/170] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:28:29 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:28:29.446551 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-b492df74-9167-46e1-91db-fd3e0466f3c4 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:29.447271 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-b492df74-9167-46e1-91db-fd3e0466f3c4 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:29.454373 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b492df74-9167-46e1-91db-fd3e0466f3c4 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:29.454963 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b492df74-9167-46e1-91db-fd3e0466f3c4 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:29.455762 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b492df74-9167-46e1-91db-fd3e0466f3c4 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:29.456195 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b492df74-9167-46e1-91db-fd3e0466f3c4 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:29.585213 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-b492df74-9167-46e1-91db-fd3e0466f3c4 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:29.592820 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-b492df74-9167-46e1-91db-fd3e0466f3c4 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1315 microversion: 2.1 time: 0.149982 Jun 01 04:28:29.593408 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 88/171] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:29 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:29.896434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-15931908-d924-4ccd-8487-c0f2fea8c2b3 req-d16bdd22-d905-4ac4-b7b7-538c592bcac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c961e06b-1b03-4e97-8487-57adba5d5e16", "name": "network-vif-plugged", "status": "completed", "tag": "690b8ab1-955e-471f-b256-fa4681ea0480"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:28:29.905330 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-15931908-d924-4ccd-8487-c0f2fea8c2b3 req-d16bdd22-d905-4ac4-b7b7-538c592bcac0 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:29.905803 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-15931908-d924-4ccd-8487-c0f2fea8c2b3 req-d16bdd22-d905-4ac4-b7b7-538c592bcac0 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:29.918752 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-15931908-d924-4ccd-8487-c0f2fea8c2b3 req-d16bdd22-d905-4ac4-b7b7-538c592bcac0 service nova] Creating event network-vif-plugged:690b8ab1-955e-471f-b256-fa4681ea0480 for instance c961e06b-1b03-4e97-8487-57adba5d5e16 on hv-cinder-66710 Jun 01 04:28:29.924969 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-15931908-d924-4ccd-8487-c0f2fea8c2b3 req-d16bdd22-d905-4ac4-b7b7-538c592bcac0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032432 Jun 01 04:28:29.925584 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 84/172] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:28:30.019491 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-f4d6309b-8761-4bfe-860d-b7a6a1da5c99 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:30.020906 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-f4d6309b-8761-4bfe-860d-b7a6a1da5c99 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:30.027194 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f4d6309b-8761-4bfe-860d-b7a6a1da5c99 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:30.027742 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f4d6309b-8761-4bfe-860d-b7a6a1da5c99 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:30.028524 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f4d6309b-8761-4bfe-860d-b7a6a1da5c99 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:30.028961 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f4d6309b-8761-4bfe-860d-b7a6a1da5c99 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:30.178763 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-2ca58eac-c581-497c-a915-e3595738b576 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:30.179565 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-2ca58eac-c581-497c-a915-e3595738b576 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:30.192824 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2ca58eac-c581-497c-a915-e3595738b576 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:30.193287 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2ca58eac-c581-497c-a915-e3595738b576 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:30.196972 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2ca58eac-c581-497c-a915-e3595738b576 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:30.197447 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2ca58eac-c581-497c-a915-e3595738b576 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:30.229773 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-f4d6309b-8761-4bfe-860d-b7a6a1da5c99 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:30.241792 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-f4d6309b-8761-4bfe-860d-b7a6a1da5c99 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1322 microversion: 2.1 time: 0.227544 Jun 01 04:28:30.251969 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 89/173] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:30 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:30.471893 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-2ca58eac-c581-497c-a915-e3595738b576 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:30.478763 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-2ca58eac-c581-497c-a915-e3595738b576 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:30.480953 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-2ca58eac-c581-497c-a915-e3595738b576 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:30.483088 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-2ca58eac-c581-497c-a915-e3595738b576 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1408 microversion: 2.20 time: 0.308865 Jun 01 04:28:30.494087 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 85/174] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:28:30 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1408 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:28:30.610647 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-0b33559a-c45e-45f7-8d26-0a64792f9b97 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:30.613768 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-0b33559a-c45e-45f7-8d26-0a64792f9b97 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:30.621462 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0b33559a-c45e-45f7-8d26-0a64792f9b97 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:30.621918 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0b33559a-c45e-45f7-8d26-0a64792f9b97 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:30.622909 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0b33559a-c45e-45f7-8d26-0a64792f9b97 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:30.623415 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0b33559a-c45e-45f7-8d26-0a64792f9b97 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:30.795082 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-0b33559a-c45e-45f7-8d26-0a64792f9b97 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:30.803277 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-0b33559a-c45e-45f7-8d26-0a64792f9b97 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1503 microversion: 2.1 time: 0.196779 Jun 01 04:28:30.804857 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 90/175] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:30 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1503 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:31.259203 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-86066b6a-2f75-4767-afc7-d319cbbd6161 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:31.259840 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-86066b6a-2f75-4767-afc7-d319cbbd6161 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:31.274220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-86066b6a-2f75-4767-afc7-d319cbbd6161 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:31.274687 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-86066b6a-2f75-4767-afc7-d319cbbd6161 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:31.275494 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-86066b6a-2f75-4767-afc7-d319cbbd6161 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:31.276289 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-86066b6a-2f75-4767-afc7-d319cbbd6161 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:31.506840 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-762dedda-caf5-446c-8f8a-d71b9255ca64 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:31.508116 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-762dedda-caf5-446c-8f8a-d71b9255ca64 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:31.520348 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-762dedda-caf5-446c-8f8a-d71b9255ca64 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:31.526695 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-762dedda-caf5-446c-8f8a-d71b9255ca64 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:31.527754 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-762dedda-caf5-446c-8f8a-d71b9255ca64 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:31.528275 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-762dedda-caf5-446c-8f8a-d71b9255ca64 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:31.639375 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-86066b6a-2f75-4767-afc7-d319cbbd6161 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:31.658834 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-86066b6a-2f75-4767-afc7-d319cbbd6161 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1322 microversion: 2.1 time: 0.403618 Jun 01 04:28:31.660690 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 86/176] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:31 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1322 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:31.712130 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-762dedda-caf5-446c-8f8a-d71b9255ca64 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:31.723483 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-762dedda-caf5-446c-8f8a-d71b9255ca64 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:31.725713 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-762dedda-caf5-446c-8f8a-d71b9255ca64 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:31.727703 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-762dedda-caf5-446c-8f8a-d71b9255ca64 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1408 microversion: 2.20 time: 0.230789 Jun 01 04:28:31.730882 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 91/177] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:28:31 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1408 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:28:32.675954 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-0e8079be-018f-4539-87a6-49599c8a680c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:32.683543 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-0e8079be-018f-4539-87a6-49599c8a680c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:32.701298 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0e8079be-018f-4539-87a6-49599c8a680c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:32.702099 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0e8079be-018f-4539-87a6-49599c8a680c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:32.703282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0e8079be-018f-4539-87a6-49599c8a680c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:32.704513 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0e8079be-018f-4539-87a6-49599c8a680c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:32.760684 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-0e315c77-3bfd-4a45-a629-505f14b85842 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:32.761412 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-0e315c77-3bfd-4a45-a629-505f14b85842 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:32.768903 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0e315c77-3bfd-4a45-a629-505f14b85842 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:32.769618 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0e315c77-3bfd-4a45-a629-505f14b85842 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:32.770808 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0e315c77-3bfd-4a45-a629-505f14b85842 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:32.771523 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0e315c77-3bfd-4a45-a629-505f14b85842 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:32.896729 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-0e8079be-018f-4539-87a6-49599c8a680c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:32.911756 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-0e8079be-018f-4539-87a6-49599c8a680c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1322 microversion: 2.1 time: 0.232987 Jun 01 04:28:32.912420 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 87/178] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:32 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:33.003563 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-0e315c77-3bfd-4a45-a629-505f14b85842 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:33.013595 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-0e315c77-3bfd-4a45-a629-505f14b85842 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:33.014223 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-0e315c77-3bfd-4a45-a629-505f14b85842 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:33.015333 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-0e315c77-3bfd-4a45-a629-505f14b85842 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1408 microversion: 2.20 time: 0.269920 Jun 01 04:28:33.016472 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 92/179] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:28:32 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1408 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:28:33.929565 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-eb3950ab-7fbd-4e3c-bcf6-42fa5e843d22 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:33.930763 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-eb3950ab-7fbd-4e3c-bcf6-42fa5e843d22 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:33.939434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-eb3950ab-7fbd-4e3c-bcf6-42fa5e843d22 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:33.939893 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-eb3950ab-7fbd-4e3c-bcf6-42fa5e843d22 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:33.940660 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-eb3950ab-7fbd-4e3c-bcf6-42fa5e843d22 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:33.943965 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-eb3950ab-7fbd-4e3c-bcf6-42fa5e843d22 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:34.035579 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-389f890b-9943-443f-9754-c1baf973588e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:34.036443 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-389f890b-9943-443f-9754-c1baf973588e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:34.057372 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-389f890b-9943-443f-9754-c1baf973588e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:34.057831 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-389f890b-9943-443f-9754-c1baf973588e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:34.058655 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-389f890b-9943-443f-9754-c1baf973588e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:34.059089 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-389f890b-9943-443f-9754-c1baf973588e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:34.155692 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-eb3950ab-7fbd-4e3c-bcf6-42fa5e843d22 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:34.164652 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-eb3950ab-7fbd-4e3c-bcf6-42fa5e843d22 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1322 microversion: 2.1 time: 0.238967 Jun 01 04:28:34.175848 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 88/180] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:33 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:34.181297 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-17490218-ee84-4e22-aefe-ab2f2e2f1eea req-c1bf25ec-61ec-4e8f-add6-dc5bfb8b438f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c4e6883-b6b6-408f-adb7-2b29610a2150", "name": "network-vif-plugged", "status": "completed", "tag": "6fd6606f-c4cc-4fce-9771-e37ea15a7749"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:28:34.190508 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-17490218-ee84-4e22-aefe-ab2f2e2f1eea req-c1bf25ec-61ec-4e8f-add6-dc5bfb8b438f service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:34.191184 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-17490218-ee84-4e22-aefe-ab2f2e2f1eea req-c1bf25ec-61ec-4e8f-add6-dc5bfb8b438f service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:34.208852 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-17490218-ee84-4e22-aefe-ab2f2e2f1eea req-c1bf25ec-61ec-4e8f-add6-dc5bfb8b438f service nova] Creating event network-vif-plugged:6fd6606f-c4cc-4fce-9771-e37ea15a7749 for instance 0c4e6883-b6b6-408f-adb7-2b29610a2150 on hv-cinder-66710 Jun 01 04:28:34.217550 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-17490218-ee84-4e22-aefe-ab2f2e2f1eea req-c1bf25ec-61ec-4e8f-add6-dc5bfb8b438f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040242 Jun 01 04:28:34.218373 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 89/181] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:28:34.225988 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-c14c4a19-9cba-40ea-a69a-54b15867da47 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17af2c47-ea53-42da-a281-5478ecf9f3d4"}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:28:34.227393 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-c14c4a19-9cba-40ea-a69a-54b15867da47 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:34.234805 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c14c4a19-9cba-40ea-a69a-54b15867da47 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:34.235776 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c14c4a19-9cba-40ea-a69a-54b15867da47 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:34.236552 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c14c4a19-9cba-40ea-a69a-54b15867da47 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:34.236986 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c14c4a19-9cba-40ea-a69a-54b15867da47 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:34.237474 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-389f890b-9943-443f-9754-c1baf973588e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:34.248681 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-389f890b-9943-443f-9754-c1baf973588e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:34.254254 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-389f890b-9943-443f-9754-c1baf973588e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:34.257746 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-389f890b-9943-443f-9754-c1baf973588e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1408 microversion: 2.20 time: 0.227296 Jun 01 04:28:34.262549 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 93/182] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:28:34 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1408 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:28:35.182279 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-80e3aaa4-42f7-412e-a167-9f9ad74713e3 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:35.184304 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-80e3aaa4-42f7-412e-a167-9f9ad74713e3 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:35.194406 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-80e3aaa4-42f7-412e-a167-9f9ad74713e3 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:35.196276 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-80e3aaa4-42f7-412e-a167-9f9ad74713e3 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:35.196276 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-80e3aaa4-42f7-412e-a167-9f9ad74713e3 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:35.196276 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-80e3aaa4-42f7-412e-a167-9f9ad74713e3 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:35.341095 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-80e3aaa4-42f7-412e-a167-9f9ad74713e3 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:35.349059 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-80e3aaa4-42f7-412e-a167-9f9ad74713e3 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1322 microversion: 2.1 time: 0.170600 Jun 01 04:28:35.349713 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 94/183] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:35 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:28:35.354135 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-47a9a55c-2a0a-49ee-8080-00091fad6e09 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:35.354901 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-47a9a55c-2a0a-49ee-8080-00091fad6e09 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:35.361780 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-47a9a55c-2a0a-49ee-8080-00091fad6e09 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:35.362310 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-47a9a55c-2a0a-49ee-8080-00091fad6e09 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:35.363416 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-47a9a55c-2a0a-49ee-8080-00091fad6e09 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:35.364088 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-47a9a55c-2a0a-49ee-8080-00091fad6e09 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:35.583543 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-47a9a55c-2a0a-49ee-8080-00091fad6e09 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:35.630998 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-47a9a55c-2a0a-49ee-8080-00091fad6e09 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:35.630998 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-47a9a55c-2a0a-49ee-8080-00091fad6e09 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:35.633851 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-47a9a55c-2a0a-49ee-8080-00091fad6e09 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1408 microversion: 2.20 time: 0.281182 Jun 01 04:28:35.638252 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 95/184] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:28:35 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1408 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:28:36.369223 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-aac7c8ac-bd34-4e25-9d49-6cf0b67a3e85 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:36.370787 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-aac7c8ac-bd34-4e25-9d49-6cf0b67a3e85 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:36.381552 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-aac7c8ac-bd34-4e25-9d49-6cf0b67a3e85 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:36.381552 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-aac7c8ac-bd34-4e25-9d49-6cf0b67a3e85 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:36.383956 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-aac7c8ac-bd34-4e25-9d49-6cf0b67a3e85 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:36.384631 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-aac7c8ac-bd34-4e25-9d49-6cf0b67a3e85 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:36.406268 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=100 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:36.416413 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-c14c4a19-9cba-40ea-a69a-54b15867da47 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "POST /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.190392 Jun 01 04:28:36.416413 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 90/185] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 1 04:28:34 2022] POST /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991/os-volume_attachments => generated 194 bytes in 2193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:28:36.525545 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-aac7c8ac-bd34-4e25-9d49-6cf0b67a3e85 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:36.533315 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-aac7c8ac-bd34-4e25-9d49-6cf0b67a3e85 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1322 microversion: 2.1 time: 0.169789 Jun 01 04:28:36.533891 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 96/186] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:36 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:28:36.653476 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-6386182c-032b-40a7-9b68-8d1459a30bde tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:36.656310 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-6386182c-032b-40a7-9b68-8d1459a30bde tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:36.663588 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6386182c-032b-40a7-9b68-8d1459a30bde tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:36.664162 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6386182c-032b-40a7-9b68-8d1459a30bde tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:36.665041 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6386182c-032b-40a7-9b68-8d1459a30bde tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:36.665607 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6386182c-032b-40a7-9b68-8d1459a30bde tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:36.884551 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-6386182c-032b-40a7-9b68-8d1459a30bde tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:36.894079 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-6386182c-032b-40a7-9b68-8d1459a30bde tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:36.895677 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-6386182c-032b-40a7-9b68-8d1459a30bde tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:36.896930 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-6386182c-032b-40a7-9b68-8d1459a30bde tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1601 microversion: 2.20 time: 0.248788 Jun 01 04:28:36.898068 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 91/187] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:28:36 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1601 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:28:36.916050 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-31152359-a870-477e-8d75-07190a3b3b26 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:36.916538 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-31152359-a870-477e-8d75-07190a3b3b26 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:36.924040 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-31152359-a870-477e-8d75-07190a3b3b26 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:36.924534 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-31152359-a870-477e-8d75-07190a3b3b26 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:36.925298 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-31152359-a870-477e-8d75-07190a3b3b26 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:36.925732 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-31152359-a870-477e-8d75-07190a3b3b26 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:37.106313 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-31152359-a870-477e-8d75-07190a3b3b26 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.194468 Jun 01 04:28:37.107759 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 97/188] 10.222.0.18 () {60 vars in 1315 bytes} [Wed Jun 1 04:28:36 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16/os-interface => generated 285 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 01 04:28:37.551462 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-ef98eeed-3b2e-4885-8fbf-874ae7af8025 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:37.555990 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-ef98eeed-3b2e-4885-8fbf-874ae7af8025 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:37.562045 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ef98eeed-3b2e-4885-8fbf-874ae7af8025 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:37.563890 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ef98eeed-3b2e-4885-8fbf-874ae7af8025 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:37.567926 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ef98eeed-3b2e-4885-8fbf-874ae7af8025 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:37.569043 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ef98eeed-3b2e-4885-8fbf-874ae7af8025 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:37.755098 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-ef98eeed-3b2e-4885-8fbf-874ae7af8025 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:37.764477 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-ef98eeed-3b2e-4885-8fbf-874ae7af8025 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1322 microversion: 2.1 time: 0.218257 Jun 01 04:28:37.765278 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 92/189] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:37 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:38.172818 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-adade96a-c16b-42fb-befe-96d41f281b98 req-01a825b6-5b46-47c6-b3d7-4db916fd399f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b5c9f1-ba93-4279-91f7-048a6923868d", "name": "network-vif-plugged", "status": "completed", "tag": "2e88e076-e176-494f-8401-4e2c11b64a89"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:28:38.183412 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-adade96a-c16b-42fb-befe-96d41f281b98 req-01a825b6-5b46-47c6-b3d7-4db916fd399f service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:38.184107 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-adade96a-c16b-42fb-befe-96d41f281b98 req-01a825b6-5b46-47c6-b3d7-4db916fd399f service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:38.286555 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-adade96a-c16b-42fb-befe-96d41f281b98 req-01a825b6-5b46-47c6-b3d7-4db916fd399f service nova] Creating event network-vif-plugged:2e88e076-e176-494f-8401-4e2c11b64a89 for instance d4b5c9f1-ba93-4279-91f7-048a6923868d on hv-cinder-66710 Jun 01 04:28:38.292022 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-adade96a-c16b-42fb-befe-96d41f281b98 req-01a825b6-5b46-47c6-b3d7-4db916fd399f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123214 Jun 01 04:28:38.292709 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 98/190] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:28:38.788338 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b8bea400-70c1-415b-b3f3-0d798cee920e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:38.790160 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-b8bea400-70c1-415b-b3f3-0d798cee920e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:38.798973 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b8bea400-70c1-415b-b3f3-0d798cee920e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:38.799672 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b8bea400-70c1-415b-b3f3-0d798cee920e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:38.800609 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b8bea400-70c1-415b-b3f3-0d798cee920e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:38.801197 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b8bea400-70c1-415b-b3f3-0d798cee920e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:39.064309 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-0add94d5-2bcb-401b-8660-481ccb94bd01 req-c44bce05-71d5-4ca7-a709-5a2f0fd51e30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c961e06b-1b03-4e97-8487-57adba5d5e16", "tag": "690b8ab1-955e-471f-b256-fa4681ea0480"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:28:39.072640 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-0add94d5-2bcb-401b-8660-481ccb94bd01 req-c44bce05-71d5-4ca7-a709-5a2f0fd51e30 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:39.073089 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-0add94d5-2bcb-401b-8660-481ccb94bd01 req-c44bce05-71d5-4ca7-a709-5a2f0fd51e30 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:39.085649 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-0add94d5-2bcb-401b-8660-481ccb94bd01 req-c44bce05-71d5-4ca7-a709-5a2f0fd51e30 service nova] Creating event network-changed:690b8ab1-955e-471f-b256-fa4681ea0480 for instance c961e06b-1b03-4e97-8487-57adba5d5e16 on hv-cinder-66710 Jun 01 04:28:39.090906 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-0add94d5-2bcb-401b-8660-481ccb94bd01 req-c44bce05-71d5-4ca7-a709-5a2f0fd51e30 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030646 Jun 01 04:28:39.091958 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 99/191] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:28:39.118081 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b8bea400-70c1-415b-b3f3-0d798cee920e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:39.122313 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:39.127150 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-b8bea400-70c1-415b-b3f3-0d798cee920e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1322 microversion: 2.1 time: 0.347580 Jun 01 04:28:39.138784 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 93/192] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:38 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1322 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:28:40.148157 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-64977528-a0bc-4e1e-aff6-e65534f82426 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:40.148157 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-64977528-a0bc-4e1e-aff6-e65534f82426 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:40.153374 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-64977528-a0bc-4e1e-aff6-e65534f82426 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:40.154146 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-64977528-a0bc-4e1e-aff6-e65534f82426 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:40.155138 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-64977528-a0bc-4e1e-aff6-e65534f82426 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:40.155815 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-64977528-a0bc-4e1e-aff6-e65534f82426 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:40.386988 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-64977528-a0bc-4e1e-aff6-e65534f82426 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:40.395354 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-64977528-a0bc-4e1e-aff6-e65534f82426 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1322 microversion: 2.1 time: 0.254116 Jun 01 04:28:40.396532 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 100/193] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:40 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:41.412566 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-753d7673-e824-4022-a48d-742b3ab3000b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:41.413277 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-753d7673-e824-4022-a48d-742b3ab3000b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:41.425877 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-753d7673-e824-4022-a48d-742b3ab3000b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:41.426698 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-753d7673-e824-4022-a48d-742b3ab3000b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:41.427743 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-753d7673-e824-4022-a48d-742b3ab3000b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:41.428403 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-753d7673-e824-4022-a48d-742b3ab3000b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:41.700060 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-753d7673-e824-4022-a48d-742b3ab3000b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:41.708513 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-753d7673-e824-4022-a48d-742b3ab3000b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1516 microversion: 2.1 time: 0.299790 Jun 01 04:28:41.709188 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 94/194] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:41 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1516 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:41.725651 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-90af99cb-308c-4f06-afe5-1c0b4721983a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:28:41.726585 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-90af99cb-308c-4f06-afe5-1c0b4721983a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:41.733157 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-90af99cb-308c-4f06-afe5-1c0b4721983a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:41.733633 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-90af99cb-308c-4f06-afe5-1c0b4721983a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:41.734392 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-90af99cb-308c-4f06-afe5-1c0b4721983a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:41.734889 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-90af99cb-308c-4f06-afe5-1c0b4721983a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:41.758405 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.objects.instance [None req-90af99cb-308c-4f06-afe5-1c0b4721983a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lazy-loading 'flavor' on Instance uuid d4b5c9f1-ba93-4279-91f7-048a6923868d {{(pid=118517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:28:42.098478 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-90af99cb-308c-4f06-afe5-1c0b4721983a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "POST /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d/action" status: 200 len: 32 microversion: 2.1 time: 0.376663 Jun 01 04:28:42.099440 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 101/195] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 1 04:28:41 2022] POST /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d/action => generated 32 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 01 04:28:42.111894 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-1b273eaa-f503-480e-9b60-47de017805d4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:42.112690 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-1b273eaa-f503-480e-9b60-47de017805d4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:42.122260 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1b273eaa-f503-480e-9b60-47de017805d4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:42.122711 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1b273eaa-f503-480e-9b60-47de017805d4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:42.123513 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1b273eaa-f503-480e-9b60-47de017805d4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:42.124097 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1b273eaa-f503-480e-9b60-47de017805d4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:42.493488 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-1b273eaa-f503-480e-9b60-47de017805d4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:42.503084 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-1b273eaa-f503-480e-9b60-47de017805d4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.397685 Jun 01 04:28:42.507262 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 95/196] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:42 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:43.528237 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-0d512c77-438a-4613-a913-a45095dbce10 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:43.528943 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-0d512c77-438a-4613-a913-a45095dbce10 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:43.536182 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0d512c77-438a-4613-a913-a45095dbce10 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:43.536631 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0d512c77-438a-4613-a913-a45095dbce10 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:43.537404 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0d512c77-438a-4613-a913-a45095dbce10 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:43.538043 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0d512c77-438a-4613-a913-a45095dbce10 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:43.694165 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-0d512c77-438a-4613-a913-a45095dbce10 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:43.702724 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-0d512c77-438a-4613-a913-a45095dbce10 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.180350 Jun 01 04:28:43.704088 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 102/197] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:43 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:44.720459 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-3126205e-7b44-48fe-92cf-b4809180434a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:44.722190 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-3126205e-7b44-48fe-92cf-b4809180434a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:44.732075 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3126205e-7b44-48fe-92cf-b4809180434a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:44.733306 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3126205e-7b44-48fe-92cf-b4809180434a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:44.734427 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3126205e-7b44-48fe-92cf-b4809180434a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:44.735476 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3126205e-7b44-48fe-92cf-b4809180434a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:44.888853 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-3126205e-7b44-48fe-92cf-b4809180434a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:44.897067 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-3126205e-7b44-48fe-92cf-b4809180434a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.180685 Jun 01 04:28:44.907214 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 96/198] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:44 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:45.917653 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-77feac20-add7-4bf7-9dc0-371831d3f2e8 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:45.924663 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-77feac20-add7-4bf7-9dc0-371831d3f2e8 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:45.928126 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-77feac20-add7-4bf7-9dc0-371831d3f2e8 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:45.928648 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-77feac20-add7-4bf7-9dc0-371831d3f2e8 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:45.930165 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-77feac20-add7-4bf7-9dc0-371831d3f2e8 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:45.930949 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-77feac20-add7-4bf7-9dc0-371831d3f2e8 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:46.099173 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-77feac20-add7-4bf7-9dc0-371831d3f2e8 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:46.116197 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-77feac20-add7-4bf7-9dc0-371831d3f2e8 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.206113 Jun 01 04:28:46.116782 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 103/199] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:45 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:47.135818 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-70ed80d4-02e8-4aa8-9e61-0573bb9860a7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:47.141578 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-70ed80d4-02e8-4aa8-9e61-0573bb9860a7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:47.146371 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-70ed80d4-02e8-4aa8-9e61-0573bb9860a7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:47.147594 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-70ed80d4-02e8-4aa8-9e61-0573bb9860a7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:47.148404 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-70ed80d4-02e8-4aa8-9e61-0573bb9860a7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:47.148850 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-70ed80d4-02e8-4aa8-9e61-0573bb9860a7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:47.319505 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-70ed80d4-02e8-4aa8-9e61-0573bb9860a7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:47.327186 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-70ed80d4-02e8-4aa8-9e61-0573bb9860a7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.196958 Jun 01 04:28:47.327799 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 97/200] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:47 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:28:48.247081 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-9252fefc-6af5-4ff5-8020-b99d66366ab4 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:48.247729 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-9252fefc-6af5-4ff5-8020-b99d66366ab4 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:48.254521 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9252fefc-6af5-4ff5-8020-b99d66366ab4 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:48.254976 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9252fefc-6af5-4ff5-8020-b99d66366ab4 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:48.255789 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9252fefc-6af5-4ff5-8020-b99d66366ab4 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:48.256223 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9252fefc-6af5-4ff5-8020-b99d66366ab4 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:48.280933 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-9252fefc-6af5-4ff5-8020-b99d66366ab4 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Going to try to terminate instance {{(pid=118517) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 01 04:28:48.346232 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-553888f7-8e34-425e-b5c0-fa4aa4b4bf7b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:48.346854 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-553888f7-8e34-425e-b5c0-fa4aa4b4bf7b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:48.353264 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-553888f7-8e34-425e-b5c0-fa4aa4b4bf7b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:48.353874 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-553888f7-8e34-425e-b5c0-fa4aa4b4bf7b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:48.354657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-553888f7-8e34-425e-b5c0-fa4aa4b4bf7b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:48.355094 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-553888f7-8e34-425e-b5c0-fa4aa4b4bf7b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:48.541141 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-553888f7-8e34-425e-b5c0-fa4aa4b4bf7b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:48.552813 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-553888f7-8e34-425e-b5c0-fa4aa4b4bf7b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.211191 Jun 01 04:28:48.565640 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 98/201] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:48 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:28:48.623164 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-9252fefc-6af5-4ff5-8020-b99d66366ab4 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 204 len: 0 microversion: 2.1 time: 0.378511 Jun 01 04:28:48.623164 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 104/202] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 1 04:28:48 2022] DELETE /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 01 04:28:48.634343 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-543c1bc9-ee85-4b69-a56f-1e077eeb36a5 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:48.635028 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-543c1bc9-ee85-4b69-a56f-1e077eeb36a5 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:48.642088 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-543c1bc9-ee85-4b69-a56f-1e077eeb36a5 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:48.642536 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-543c1bc9-ee85-4b69-a56f-1e077eeb36a5 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:48.643384 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-543c1bc9-ee85-4b69-a56f-1e077eeb36a5 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:48.644083 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-543c1bc9-ee85-4b69-a56f-1e077eeb36a5 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:48.786328 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-543c1bc9-ee85-4b69-a56f-1e077eeb36a5 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:48.795839 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-543c1bc9-ee85-4b69-a56f-1e077eeb36a5 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1555 microversion: 2.1 time: 0.167876 Jun 01 04:28:48.796434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 99/203] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:48 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:49.573677 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-1eccb3a0-e32c-428a-ad58-0150e16e2ef8 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:49.574377 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-1eccb3a0-e32c-428a-ad58-0150e16e2ef8 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:49.584235 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1eccb3a0-e32c-428a-ad58-0150e16e2ef8 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:49.585110 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1eccb3a0-e32c-428a-ad58-0150e16e2ef8 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:49.586532 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1eccb3a0-e32c-428a-ad58-0150e16e2ef8 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:49.588191 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1eccb3a0-e32c-428a-ad58-0150e16e2ef8 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:49.773370 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-1eccb3a0-e32c-428a-ad58-0150e16e2ef8 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:49.781627 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-1eccb3a0-e32c-428a-ad58-0150e16e2ef8 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.213876 Jun 01 04:28:49.782193 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 105/204] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:49 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:49.813921 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-a111952f-f8a6-497d-baf2-02137873f9e7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:49.814631 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-a111952f-f8a6-497d-baf2-02137873f9e7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:49.821441 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a111952f-f8a6-497d-baf2-02137873f9e7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:49.821973 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a111952f-f8a6-497d-baf2-02137873f9e7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:49.822735 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a111952f-f8a6-497d-baf2-02137873f9e7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:49.823168 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a111952f-f8a6-497d-baf2-02137873f9e7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:50.024031 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-a111952f-f8a6-497d-baf2-02137873f9e7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:50.044657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-a111952f-f8a6-497d-baf2-02137873f9e7 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1555 microversion: 2.1 time: 0.234941 Jun 01 04:28:50.047167 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 100/205] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:49 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1555 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:50.800525 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-c63d66f6-42ec-411f-aef2-a38f78c6bc9f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:50.801148 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-c63d66f6-42ec-411f-aef2-a38f78c6bc9f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:50.807293 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c63d66f6-42ec-411f-aef2-a38f78c6bc9f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:50.807765 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c63d66f6-42ec-411f-aef2-a38f78c6bc9f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:50.808564 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c63d66f6-42ec-411f-aef2-a38f78c6bc9f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:50.808993 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c63d66f6-42ec-411f-aef2-a38f78c6bc9f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:50.954451 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-c63d66f6-42ec-411f-aef2-a38f78c6bc9f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:50.962059 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-c63d66f6-42ec-411f-aef2-a38f78c6bc9f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.165894 Jun 01 04:28:50.962678 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 106/206] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:50 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:51.062691 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-e5a3931a-8ace-42e2-bfd5-a33ca852d704 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:51.063175 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-e5a3931a-8ace-42e2-bfd5-a33ca852d704 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:51.073692 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e5a3931a-8ace-42e2-bfd5-a33ca852d704 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:51.074146 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e5a3931a-8ace-42e2-bfd5-a33ca852d704 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:51.074926 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e5a3931a-8ace-42e2-bfd5-a33ca852d704 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:51.076690 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e5a3931a-8ace-42e2-bfd5-a33ca852d704 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:51.263174 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-e5a3931a-8ace-42e2-bfd5-a33ca852d704 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:51.271878 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-e5a3931a-8ace-42e2-bfd5-a33ca852d704 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1555 microversion: 2.1 time: 0.213221 Jun 01 04:28:51.272649 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 101/207] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:51 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1555 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:51.982661 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-42d35319-b3fd-4ef3-a0c6-41bc69304e3d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:51.983286 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-42d35319-b3fd-4ef3-a0c6-41bc69304e3d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:51.990093 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-42d35319-b3fd-4ef3-a0c6-41bc69304e3d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:51.990614 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-42d35319-b3fd-4ef3-a0c6-41bc69304e3d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:51.996505 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-42d35319-b3fd-4ef3-a0c6-41bc69304e3d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:51.996505 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-42d35319-b3fd-4ef3-a0c6-41bc69304e3d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:52.155680 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-42d35319-b3fd-4ef3-a0c6-41bc69304e3d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:52.164130 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-42d35319-b3fd-4ef3-a0c6-41bc69304e3d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.185340 Jun 01 04:28:52.174506 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 107/208] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:51 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:52.290331 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-908c1ab0-e72c-4690-8736-7f79f5c09bc0 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:52.291087 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-908c1ab0-e72c-4690-8736-7f79f5c09bc0 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:52.298335 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-908c1ab0-e72c-4690-8736-7f79f5c09bc0 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:52.298788 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-908c1ab0-e72c-4690-8736-7f79f5c09bc0 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:52.299602 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-908c1ab0-e72c-4690-8736-7f79f5c09bc0 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:52.300039 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-908c1ab0-e72c-4690-8736-7f79f5c09bc0 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:52.440880 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-908c1ab0-e72c-4690-8736-7f79f5c09bc0 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:52.454782 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-908c1ab0-e72c-4690-8736-7f79f5c09bc0 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1555 microversion: 2.1 time: 0.167608 Jun 01 04:28:52.461437 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 102/209] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:52 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:53.182791 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-5c02ac6f-3c07-47ff-be51-1e37e9a47ae0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:53.183246 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-5c02ac6f-3c07-47ff-be51-1e37e9a47ae0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:53.189812 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5c02ac6f-3c07-47ff-be51-1e37e9a47ae0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:53.190262 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5c02ac6f-3c07-47ff-be51-1e37e9a47ae0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:53.191033 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5c02ac6f-3c07-47ff-be51-1e37e9a47ae0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:53.191501 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5c02ac6f-3c07-47ff-be51-1e37e9a47ae0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:53.342621 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-5c02ac6f-3c07-47ff-be51-1e37e9a47ae0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:53.350121 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-5c02ac6f-3c07-47ff-be51-1e37e9a47ae0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.172174 Jun 01 04:28:53.350703 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 108/210] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:53 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:53.472194 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-afac5b38-2865-4dec-9482-0befb20cfa9a tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:53.473354 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-afac5b38-2865-4dec-9482-0befb20cfa9a tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:53.480499 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-afac5b38-2865-4dec-9482-0befb20cfa9a tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:53.481133 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-afac5b38-2865-4dec-9482-0befb20cfa9a tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:53.482049 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-afac5b38-2865-4dec-9482-0befb20cfa9a tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:53.482922 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-afac5b38-2865-4dec-9482-0befb20cfa9a tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:53.625130 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-afac5b38-2865-4dec-9482-0befb20cfa9a tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:53.636553 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-afac5b38-2865-4dec-9482-0befb20cfa9a tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1555 microversion: 2.1 time: 0.168370 Jun 01 04:28:53.637263 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 103/211] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:53 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:54.368373 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-6f7bf723-0f5a-49ce-9b56-2f565e69590e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:54.368973 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-6f7bf723-0f5a-49ce-9b56-2f565e69590e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:54.375681 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6f7bf723-0f5a-49ce-9b56-2f565e69590e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:54.376195 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6f7bf723-0f5a-49ce-9b56-2f565e69590e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:54.376960 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6f7bf723-0f5a-49ce-9b56-2f565e69590e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:54.377411 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6f7bf723-0f5a-49ce-9b56-2f565e69590e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:54.567847 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-6f7bf723-0f5a-49ce-9b56-2f565e69590e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:54.577116 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-6f7bf723-0f5a-49ce-9b56-2f565e69590e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.212439 Jun 01 04:28:54.578932 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 109/212] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:54 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:54.653928 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-066ac3fa-88d8-4912-a12f-d8cd34574d49 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:54.654539 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-066ac3fa-88d8-4912-a12f-d8cd34574d49 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:54.661160 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-066ac3fa-88d8-4912-a12f-d8cd34574d49 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:54.661565 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-066ac3fa-88d8-4912-a12f-d8cd34574d49 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:54.662333 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-066ac3fa-88d8-4912-a12f-d8cd34574d49 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:54.662774 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-066ac3fa-88d8-4912-a12f-d8cd34574d49 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:54.818420 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-066ac3fa-88d8-4912-a12f-d8cd34574d49 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:54.827269 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-066ac3fa-88d8-4912-a12f-d8cd34574d49 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1555 microversion: 2.1 time: 0.177143 Jun 01 04:28:54.827871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 104/213] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:54 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1555 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:55.598037 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-f08106bf-a498-41a8-af7b-2d43d870f35e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:55.598727 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-f08106bf-a498-41a8-af7b-2d43d870f35e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:55.609945 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f08106bf-a498-41a8-af7b-2d43d870f35e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:55.610631 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f08106bf-a498-41a8-af7b-2d43d870f35e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:55.615052 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f08106bf-a498-41a8-af7b-2d43d870f35e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:55.615858 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f08106bf-a498-41a8-af7b-2d43d870f35e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:55.802873 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-f08106bf-a498-41a8-af7b-2d43d870f35e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:55.811654 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-f08106bf-a498-41a8-af7b-2d43d870f35e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.220145 Jun 01 04:28:55.812527 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 110/214] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:55 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:55.844123 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-a12887e7-fcf1-44d5-aae7-c6da031c1198 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:55.845331 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-a12887e7-fcf1-44d5-aae7-c6da031c1198 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:55.852121 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a12887e7-fcf1-44d5-aae7-c6da031c1198 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:55.852793 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a12887e7-fcf1-44d5-aae7-c6da031c1198 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:55.853581 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a12887e7-fcf1-44d5-aae7-c6da031c1198 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:55.854028 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a12887e7-fcf1-44d5-aae7-c6da031c1198 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:56.031424 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-a12887e7-fcf1-44d5-aae7-c6da031c1198 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:56.040496 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-a12887e7-fcf1-44d5-aae7-c6da031c1198 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1555 microversion: 2.1 time: 0.200257 Jun 01 04:28:56.041262 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 105/215] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:55 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1555 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:56.195426 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-6eeb164f-7c9a-4ea6-a89d-6f3c8ef8bd15 req-1c31a084-7402-4a77-aedd-1a0c5ceaa353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb2f4fea-bee1-42d9-8db6-985d2f390991", "name": "network-vif-deleted", "tag": "26362886-e304-4f86-af04-dede6afa3f35"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:28:56.204717 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-6eeb164f-7c9a-4ea6-a89d-6f3c8ef8bd15 req-1c31a084-7402-4a77-aedd-1a0c5ceaa353 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:56.205472 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-6eeb164f-7c9a-4ea6-a89d-6f3c8ef8bd15 req-1c31a084-7402-4a77-aedd-1a0c5ceaa353 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:56.211446 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:56.219752 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-6eeb164f-7c9a-4ea6-a89d-6f3c8ef8bd15 req-1c31a084-7402-4a77-aedd-1a0c5ceaa353 service nova] Creating event network-vif-deleted:26362886-e304-4f86-af04-dede6afa3f35 for instance bb2f4fea-bee1-42d9-8db6-985d2f390991 on hv-cinder-66710 Jun 01 04:28:56.226034 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-6eeb164f-7c9a-4ea6-a89d-6f3c8ef8bd15 req-1c31a084-7402-4a77-aedd-1a0c5ceaa353 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041273 Jun 01 04:28:56.226852 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 111/216] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:28:56.830299 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d6e3e101-15b2-4edc-9db3-ed47b2b01453 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:56.830923 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-d6e3e101-15b2-4edc-9db3-ed47b2b01453 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:56.856315 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d6e3e101-15b2-4edc-9db3-ed47b2b01453 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:56.856923 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d6e3e101-15b2-4edc-9db3-ed47b2b01453 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:56.857856 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d6e3e101-15b2-4edc-9db3-ed47b2b01453 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:56.858513 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d6e3e101-15b2-4edc-9db3-ed47b2b01453 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:57.025308 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-d6e3e101-15b2-4edc-9db3-ed47b2b01453 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:57.036590 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-d6e3e101-15b2-4edc-9db3-ed47b2b01453 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.210727 Jun 01 04:28:57.046748 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 106/217] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:56 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:57.071209 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-9f697e64-bfa2-48be-89d0-e381c4de4fed tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:57.075796 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-9f697e64-bfa2-48be-89d0-e381c4de4fed tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:57.098131 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9f697e64-bfa2-48be-89d0-e381c4de4fed tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:57.098668 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9f697e64-bfa2-48be-89d0-e381c4de4fed tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:57.099518 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9f697e64-bfa2-48be-89d0-e381c4de4fed tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:57.100024 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9f697e64-bfa2-48be-89d0-e381c4de4fed tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:57.137679 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9f697e64-bfa2-48be-89d0-e381c4de4fed tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:57.137679 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9f697e64-bfa2-48be-89d0-e381c4de4fed tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:57.137679 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.objects.instance [None req-9f697e64-bfa2-48be-89d0-e381c4de4fed tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lazy-loading 'fault' on Instance uuid bb2f4fea-bee1-42d9-8db6-985d2f390991 {{(pid=118517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:28:57.183733 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-9f697e64-bfa2-48be-89d0-e381c4de4fed tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2eb70d1582b4876931f05cd4015a346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eb15379902c4745a1e3fd5b83d0e4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:57.193009 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-9f697e64-bfa2-48be-89d0-e381c4de4fed tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 200 len: 1351 microversion: 2.1 time: 0.136358 Jun 01 04:28:57.194795 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 112/218] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:57 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 1351 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:28:58.054098 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-4aa91fe2-846e-46ca-a9fd-b6d81714c821 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:58.054897 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-4aa91fe2-846e-46ca-a9fd-b6d81714c821 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:58.061809 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4aa91fe2-846e-46ca-a9fd-b6d81714c821 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:58.063032 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4aa91fe2-846e-46ca-a9fd-b6d81714c821 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:58.063150 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4aa91fe2-846e-46ca-a9fd-b6d81714c821 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:58.063597 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4aa91fe2-846e-46ca-a9fd-b6d81714c821 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:58.209295 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-4aa91fe2-846e-46ca-a9fd-b6d81714c821 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:58.211917 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a913b931-a49d-4045-8302-58c1f2fcd989 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:58.212524 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-a913b931-a49d-4045-8302-58c1f2fcd989 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:58.217328 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-4aa91fe2-846e-46ca-a9fd-b6d81714c821 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.167445 Jun 01 04:28:58.217889 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 107/219] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:58 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:28:58.219439 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a913b931-a49d-4045-8302-58c1f2fcd989 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:58.220036 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a913b931-a49d-4045-8302-58c1f2fcd989 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:58.220906 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a913b931-a49d-4045-8302-58c1f2fcd989 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:58.221808 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a913b931-a49d-4045-8302-58c1f2fcd989 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:58.236040 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.wsgi [None req-a913b931-a49d-4045-8302-58c1f2fcd989 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] HTTP exception thrown: Instance bb2f4fea-bee1-42d9-8db6-985d2f390991 could not be found. Jun 01 04:28:58.242137 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a913b931-a49d-4045-8302-58c1f2fcd989 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Request method failure captured: Jun 01 04:28:58.242137 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: request: GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 HTTP/1.1 Jun 01 04:28:58.242137 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept: application/json Jun 01 04:28:58.242137 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept-Encoding: identity Jun 01 04:28:58.242137 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Connection: close Jun 01 04:28:58.242137 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Length: 0 Jun 01 04:28:58.242137 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Type: application/json Jun 01 04:28:58.242137 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Host: 10.222.0.18 Jun 01 04:28:58.242137 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Openstack-System-Scope: None Jun 01 04:28:58.242137 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: User-Agent: python-urllib3/1.26.9 Jun 01 04:28:58.242137 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Auth-Token: gAAAAABiluqyG9XF8qSxIUN3TFmjk6eg79rCGaY-g92UiT08JZxMXeKCL5CqlAOWtG2ztoXLc0Or839t70C6avZqPc9mPG2uzOWhaOEFT9Rz1YySzhjARzvXAD2qRYn5e8TMIPiOEdo5hGAQ5KX82JwUbvdIWK__duoZRR8N0NRaH-H_IKUXAto Jun 01 04:28:58.242137 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Id: None Jun 01 04:28:58.242137 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Name: None Jun 01 04:28:58.242137 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Identity-Status: Confirmed Jun 01 04:28:58.242137 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Is-Admin-Project: True Jun 01 04:28:58.242137 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Id: default Jun 01 04:28:58.242137 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Name: Default Jun 01 04:28:58.242137 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Id: 8eb15379902c4745a1e3fd5b83d0e4be Jun 01 04:28:58.242137 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Name: tempest-DeleteServersTestJSON-895117407 Jun 01 04:28:58.242137 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Role: reader,member Jun 01 04:28:58.242137 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Roles: reader,member Jun 01 04:28:58.243290 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8eb15379902c4745a1e3fd5b83d0e4be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8eb15379902c4745a1e3fd5b83d0e4be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8eb15379902c4745a1e3fd5b83d0e4be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8eb15379902c4745a1e3fd5b83d0e4be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:28:58.243290 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant: tempest-DeleteServersTestJSON-895117407 Jun 01 04:28:58.243290 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Id: 8eb15379902c4745a1e3fd5b83d0e4be Jun 01 04:28:58.243290 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Name: tempest-DeleteServersTestJSON-895117407 Jun 01 04:28:58.243290 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User: tempest-DeleteServersTestJSON-895117407-project Jun 01 04:28:58.243290 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Id: default Jun 01 04:28:58.243290 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Name: Default Jun 01 04:28:58.243290 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Id: c2eb70d1582b4876931f05cd4015a346 Jun 01 04:28:58.243290 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Name: tempest-DeleteServersTestJSON-895117407-project Jun 01 04:28:58.243290 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: method: > Jun 01 04:28:58.243290 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: exception: Instance bb2f4fea-bee1-42d9-8db6-985d2f390991 could not be found. Jun 01 04:28:58.243290 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: action_args: {'id': 'bb2f4fea-bee1-42d9-8db6-985d2f390991'} Jun 01 04:28:58.244128 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:28:58.244128 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:28:58.244128 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:28:58.244128 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:28:58.244128 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:28:58.244128 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:28:58.244128 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:28:58.244128 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:28:58.244128 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:28:58.244128 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:28:58.244128 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb2f4fea-bee1-42d9-8db6-985d2f390991 could not be found. Jun 01 04:28:58.244128 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:28:58.244128 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:28:58.244128 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:28:58.244128 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:28:58.244128 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:28:58.244128 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:28:58.244128 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:28:58.244128 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:28:58.244128 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:28:58.245596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:28:58.245596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 01 04:28:58.245596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 01 04:28:58.245596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:28:58.245596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:28:58.245596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:28:58.245596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:28:58.245596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb2f4fea-bee1-42d9-8db6-985d2f390991 could not be found. Jun 01 04:28:58.245596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:28:58.245596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:28:58.245596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:28:58.245596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:28:58.245596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:28:58.245596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:28:58.245596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:28:58.245596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:28:58.245596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb2f4fea-bee1-42d9-8db6-985d2f390991 could not be found. Jun 01 04:28:58.245596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:28:58.246831 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a913b931-a49d-4045-8302-58c1f2fcd989 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Returning 404 to user: Instance bb2f4fea-bee1-42d9-8db6-985d2f390991 could not be found. {{(pid=118517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:28:58.246831 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-a913b931-a49d-4045-8302-58c1f2fcd989 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 404 len: 111 microversion: 2.1 time: 0.035048 Jun 01 04:28:58.246831 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 113/220] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:58 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 01 04:28:58.363449 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-f8093427-2108-45e5-911a-8a3c14386803 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:58.364388 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-f8093427-2108-45e5-911a-8a3c14386803 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:58.370565 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f8093427-2108-45e5-911a-8a3c14386803 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:58.371018 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f8093427-2108-45e5-911a-8a3c14386803 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:58.371930 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f8093427-2108-45e5-911a-8a3c14386803 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:58.372366 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f8093427-2108-45e5-911a-8a3c14386803 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:58.386763 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.wsgi [None req-f8093427-2108-45e5-911a-8a3c14386803 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] HTTP exception thrown: Instance bb2f4fea-bee1-42d9-8db6-985d2f390991 could not be found. Jun 01 04:28:58.391267 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-f8093427-2108-45e5-911a-8a3c14386803 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Request method failure captured: Jun 01 04:28:58.391267 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: request: GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991/os-volume_attachments HTTP/1.1 Jun 01 04:28:58.391267 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept: application/json Jun 01 04:28:58.391267 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept-Encoding: identity Jun 01 04:28:58.391267 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Connection: close Jun 01 04:28:58.391267 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Length: 0 Jun 01 04:28:58.391267 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Type: application/json Jun 01 04:28:58.391267 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Host: 10.222.0.18 Jun 01 04:28:58.391267 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Openstack-System-Scope: None Jun 01 04:28:58.391267 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: User-Agent: python-urllib3/1.26.9 Jun 01 04:28:58.391267 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Auth-Token: gAAAAABiluqyG9XF8qSxIUN3TFmjk6eg79rCGaY-g92UiT08JZxMXeKCL5CqlAOWtG2ztoXLc0Or839t70C6avZqPc9mPG2uzOWhaOEFT9Rz1YySzhjARzvXAD2qRYn5e8TMIPiOEdo5hGAQ5KX82JwUbvdIWK__duoZRR8N0NRaH-H_IKUXAto Jun 01 04:28:58.391267 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Id: None Jun 01 04:28:58.391267 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Name: None Jun 01 04:28:58.391267 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Identity-Status: Confirmed Jun 01 04:28:58.391267 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Is-Admin-Project: True Jun 01 04:28:58.391267 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Id: default Jun 01 04:28:58.391267 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Name: Default Jun 01 04:28:58.391267 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Id: 8eb15379902c4745a1e3fd5b83d0e4be Jun 01 04:28:58.391267 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Name: tempest-DeleteServersTestJSON-895117407 Jun 01 04:28:58.391267 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Role: reader,member Jun 01 04:28:58.391267 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Roles: reader,member Jun 01 04:28:58.392500 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8eb15379902c4745a1e3fd5b83d0e4be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8eb15379902c4745a1e3fd5b83d0e4be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8eb15379902c4745a1e3fd5b83d0e4be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8eb15379902c4745a1e3fd5b83d0e4be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:28:58.392500 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant: tempest-DeleteServersTestJSON-895117407 Jun 01 04:28:58.392500 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Id: 8eb15379902c4745a1e3fd5b83d0e4be Jun 01 04:28:58.392500 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Name: tempest-DeleteServersTestJSON-895117407 Jun 01 04:28:58.392500 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User: tempest-DeleteServersTestJSON-895117407-project Jun 01 04:28:58.392500 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Id: default Jun 01 04:28:58.392500 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Name: Default Jun 01 04:28:58.392500 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Id: c2eb70d1582b4876931f05cd4015a346 Jun 01 04:28:58.392500 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Name: tempest-DeleteServersTestJSON-895117407-project Jun 01 04:28:58.392500 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: method: > Jun 01 04:28:58.392500 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: exception: Instance bb2f4fea-bee1-42d9-8db6-985d2f390991 could not be found. Jun 01 04:28:58.392500 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: action_args: {'server_id': 'bb2f4fea-bee1-42d9-8db6-985d2f390991'} Jun 01 04:28:58.393839 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:28:58.393839 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:28:58.393839 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:28:58.393839 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:28:58.393839 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:28:58.393839 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:28:58.393839 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:28:58.393839 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:28:58.393839 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:28:58.393839 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:28:58.393839 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb2f4fea-bee1-42d9-8db6-985d2f390991 could not be found. Jun 01 04:28:58.393839 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:28:58.393839 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:28:58.393839 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:28:58.393839 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:28:58.393839 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:28:58.393839 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:28:58.393839 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:28:58.393839 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:28:58.393839 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:28:58.395104 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:28:58.395104 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 01 04:28:58.395104 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 01 04:28:58.395104 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 01 04:28:58.395104 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 01 04:28:58.395104 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 01 04:28:58.395104 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 01 04:28:58.395104 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:28:58.395104 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:28:58.395104 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb2f4fea-bee1-42d9-8db6-985d2f390991 could not be found. Jun 01 04:28:58.395104 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:28:58.395104 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:28:58.395104 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:28:58.395104 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:28:58.395104 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:28:58.395104 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:28:58.395104 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:28:58.395104 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:28:58.395104 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb2f4fea-bee1-42d9-8db6-985d2f390991 could not be found. Jun 01 04:28:58.395104 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:28:58.396727 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-f8093427-2108-45e5-911a-8a3c14386803 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Returning 404 to user: Instance bb2f4fea-bee1-42d9-8db6-985d2f390991 could not be found. {{(pid=118516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:28:58.396727 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-f8093427-2108-45e5-911a-8a3c14386803 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033414 Jun 01 04:28:58.396727 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 108/221] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 1 04:28:58 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:28:59.235431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-ceac93b8-9386-43a3-a38a-2d90e218c960 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:28:59.237068 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-ceac93b8-9386-43a3-a38a-2d90e218c960 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:28:59.246006 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ceac93b8-9386-43a3-a38a-2d90e218c960 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:59.246520 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ceac93b8-9386-43a3-a38a-2d90e218c960 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:59.247405 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ceac93b8-9386-43a3-a38a-2d90e218c960 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:28:59.247768 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ceac93b8-9386-43a3-a38a-2d90e218c960 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:28:59.397943 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-ceac93b8-9386-43a3-a38a-2d90e218c960 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:28:59.405706 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-ceac93b8-9386-43a3-a38a-2d90e218c960 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.175082 Jun 01 04:28:59.406263 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 114/222] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:28:59 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:00.423527 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b2e15c30-8cd6-4f58-bf49-68634fbfca28 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:00.424131 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-b2e15c30-8cd6-4f58-bf49-68634fbfca28 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:00.426811 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_api:SELECT=52 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:00.432005 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b2e15c30-8cd6-4f58-bf49-68634fbfca28 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:00.432551 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b2e15c30-8cd6-4f58-bf49-68634fbfca28 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:00.433318 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b2e15c30-8cd6-4f58-bf49-68634fbfca28 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:00.433755 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b2e15c30-8cd6-4f58-bf49-68634fbfca28 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:00.569422 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b2e15c30-8cd6-4f58-bf49-68634fbfca28 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:00.576985 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-b2e15c30-8cd6-4f58-bf49-68634fbfca28 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.157459 Jun 01 04:29:00.577555 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 109/223] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:00 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:01.593899 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-bbb6e08b-5c88-4c9a-aa8e-f8bd4715607d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:01.594486 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-bbb6e08b-5c88-4c9a-aa8e-f8bd4715607d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:01.596571 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:01.601478 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bbb6e08b-5c88-4c9a-aa8e-f8bd4715607d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:01.601924 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bbb6e08b-5c88-4c9a-aa8e-f8bd4715607d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:01.602685 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bbb6e08b-5c88-4c9a-aa8e-f8bd4715607d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:01.603116 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bbb6e08b-5c88-4c9a-aa8e-f8bd4715607d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:01.729156 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-bbb6e08b-5c88-4c9a-aa8e-f8bd4715607d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:01.737057 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-bbb6e08b-5c88-4c9a-aa8e-f8bd4715607d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.146974 Jun 01 04:29:01.737881 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 115/224] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:01 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:02.753901 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-95ec52f0-c6b9-4cbc-9894-5591748a162d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:02.755123 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-95ec52f0-c6b9-4cbc-9894-5591748a162d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:02.761950 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-95ec52f0-c6b9-4cbc-9894-5591748a162d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:02.762397 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-95ec52f0-c6b9-4cbc-9894-5591748a162d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:02.763166 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-95ec52f0-c6b9-4cbc-9894-5591748a162d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:02.763617 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-95ec52f0-c6b9-4cbc-9894-5591748a162d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:02.893002 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-95ec52f0-c6b9-4cbc-9894-5591748a162d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:02.900523 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-95ec52f0-c6b9-4cbc-9894-5591748a162d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.150524 Jun 01 04:29:02.901090 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 110/225] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:02 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:03.917569 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a847d56a-45d3-4ffb-823b-e305d9742bec tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:03.918151 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-a847d56a-45d3-4ffb-823b-e305d9742bec tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:03.924266 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a847d56a-45d3-4ffb-823b-e305d9742bec tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:03.924806 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a847d56a-45d3-4ffb-823b-e305d9742bec tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:03.925553 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a847d56a-45d3-4ffb-823b-e305d9742bec tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:03.925983 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a847d56a-45d3-4ffb-823b-e305d9742bec tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:04.062617 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-a847d56a-45d3-4ffb-823b-e305d9742bec tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:04.070890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-a847d56a-45d3-4ffb-823b-e305d9742bec tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.157068 Jun 01 04:29:04.071489 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 116/226] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:03 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:05.088691 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-86ad6b9e-94b0-4ac2-9fb2-90e3d12dc0cd tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:05.089290 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-86ad6b9e-94b0-4ac2-9fb2-90e3d12dc0cd tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:05.095313 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-86ad6b9e-94b0-4ac2-9fb2-90e3d12dc0cd tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:05.095792 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-86ad6b9e-94b0-4ac2-9fb2-90e3d12dc0cd tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:05.096548 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-86ad6b9e-94b0-4ac2-9fb2-90e3d12dc0cd tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:05.096983 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-86ad6b9e-94b0-4ac2-9fb2-90e3d12dc0cd tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:05.101912 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=100 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:05.239376 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-86ad6b9e-94b0-4ac2-9fb2-90e3d12dc0cd tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:05.246902 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-86ad6b9e-94b0-4ac2-9fb2-90e3d12dc0cd tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.162235 Jun 01 04:29:05.247485 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 111/227] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:05 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:05.278290 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-4e8cec0a-d2b2-4034-8be5-734634412f43 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:05.278846 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-4e8cec0a-d2b2-4034-8be5-734634412f43 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:05.284865 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4e8cec0a-d2b2-4034-8be5-734634412f43 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:05.285380 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4e8cec0a-d2b2-4034-8be5-734634412f43 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:05.286790 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4e8cec0a-d2b2-4034-8be5-734634412f43 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:05.287276 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4e8cec0a-d2b2-4034-8be5-734634412f43 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:05.300636 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.wsgi [None req-4e8cec0a-d2b2-4034-8be5-734634412f43 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] HTTP exception thrown: Instance bb2f4fea-bee1-42d9-8db6-985d2f390991 could not be found. Jun 01 04:29:05.302243 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-4e8cec0a-d2b2-4034-8be5-734634412f43 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Request method failure captured: Jun 01 04:29:05.302243 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: request: DELETE /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 HTTP/1.1 Jun 01 04:29:05.302243 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept: application/json Jun 01 04:29:05.302243 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept-Encoding: identity Jun 01 04:29:05.302243 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Connection: close Jun 01 04:29:05.302243 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Length: 0 Jun 01 04:29:05.302243 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Type: application/json Jun 01 04:29:05.302243 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Host: 10.222.0.18 Jun 01 04:29:05.302243 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Openstack-System-Scope: None Jun 01 04:29:05.302243 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: User-Agent: python-urllib3/1.26.9 Jun 01 04:29:05.302243 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Auth-Token: gAAAAABiluqyG9XF8qSxIUN3TFmjk6eg79rCGaY-g92UiT08JZxMXeKCL5CqlAOWtG2ztoXLc0Or839t70C6avZqPc9mPG2uzOWhaOEFT9Rz1YySzhjARzvXAD2qRYn5e8TMIPiOEdo5hGAQ5KX82JwUbvdIWK__duoZRR8N0NRaH-H_IKUXAto Jun 01 04:29:05.302243 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Id: None Jun 01 04:29:05.302243 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Name: None Jun 01 04:29:05.302243 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Identity-Status: Confirmed Jun 01 04:29:05.302243 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Is-Admin-Project: True Jun 01 04:29:05.302243 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Id: default Jun 01 04:29:05.302243 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Name: Default Jun 01 04:29:05.302243 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Id: 8eb15379902c4745a1e3fd5b83d0e4be Jun 01 04:29:05.302243 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Name: tempest-DeleteServersTestJSON-895117407 Jun 01 04:29:05.302243 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Role: reader,member Jun 01 04:29:05.302243 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Roles: reader,member Jun 01 04:29:05.303675 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8eb15379902c4745a1e3fd5b83d0e4be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8eb15379902c4745a1e3fd5b83d0e4be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8eb15379902c4745a1e3fd5b83d0e4be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8eb15379902c4745a1e3fd5b83d0e4be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:29:05.303675 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant: tempest-DeleteServersTestJSON-895117407 Jun 01 04:29:05.303675 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Id: 8eb15379902c4745a1e3fd5b83d0e4be Jun 01 04:29:05.303675 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Name: tempest-DeleteServersTestJSON-895117407 Jun 01 04:29:05.303675 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User: tempest-DeleteServersTestJSON-895117407-project Jun 01 04:29:05.303675 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Id: default Jun 01 04:29:05.303675 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Name: Default Jun 01 04:29:05.303675 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Id: c2eb70d1582b4876931f05cd4015a346 Jun 01 04:29:05.303675 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Name: tempest-DeleteServersTestJSON-895117407-project Jun 01 04:29:05.303675 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: method: > Jun 01 04:29:05.303675 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: exception: Instance bb2f4fea-bee1-42d9-8db6-985d2f390991 could not be found. Jun 01 04:29:05.303675 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: action_args: {'id': 'bb2f4fea-bee1-42d9-8db6-985d2f390991'} Jun 01 04:29:05.304465 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:29:05.304465 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:29:05.304465 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:29:05.304465 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:29:05.304465 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:29:05.304465 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:29:05.304465 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:29:05.304465 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:29:05.304465 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:29:05.304465 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:29:05.304465 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb2f4fea-bee1-42d9-8db6-985d2f390991 could not be found. Jun 01 04:29:05.304465 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:29:05.304465 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:29:05.304465 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:29:05.304465 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:29:05.304465 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:29:05.304465 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:29:05.304465 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:29:05.304465 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:29:05.304465 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:29:05.305807 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:29:05.305807 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 01 04:29:05.305807 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 01 04:29:05.305807 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 01 04:29:05.305807 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 01 04:29:05.305807 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:29:05.305807 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:29:05.305807 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:29:05.305807 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:29:05.305807 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb2f4fea-bee1-42d9-8db6-985d2f390991 could not be found. Jun 01 04:29:05.305807 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:29:05.305807 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:29:05.305807 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:29:05.305807 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:29:05.305807 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:29:05.305807 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:29:05.305807 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:29:05.305807 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:29:05.305807 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb2f4fea-bee1-42d9-8db6-985d2f390991 could not be found. Jun 01 04:29:05.305807 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:29:05.307496 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-4e8cec0a-d2b2-4034-8be5-734634412f43 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Returning 404 to user: Instance bb2f4fea-bee1-42d9-8db6-985d2f390991 could not be found. {{(pid=118517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:29:05.307496 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-4e8cec0a-d2b2-4034-8be5-734634412f43 tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 404 len: 111 microversion: 2.1 time: 0.029936 Jun 01 04:29:05.307496 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 117/228] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 1 04:29:05 2022] DELETE /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:29:05.312356 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b37a2ff3-eb86-4068-8f18-0e563c6f5b1d tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:05.312958 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-b37a2ff3-eb86-4068-8f18-0e563c6f5b1d tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] [instance: bb2f4fea-bee1-42d9-8db6-985d2f390991] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:05.320582 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b37a2ff3-eb86-4068-8f18-0e563c6f5b1d tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:05.320582 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b37a2ff3-eb86-4068-8f18-0e563c6f5b1d tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:05.321692 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b37a2ff3-eb86-4068-8f18-0e563c6f5b1d tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:05.321692 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b37a2ff3-eb86-4068-8f18-0e563c6f5b1d tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:05.335930 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.wsgi [None req-b37a2ff3-eb86-4068-8f18-0e563c6f5b1d tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] HTTP exception thrown: Instance bb2f4fea-bee1-42d9-8db6-985d2f390991 could not be found. Jun 01 04:29:05.338060 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b37a2ff3-eb86-4068-8f18-0e563c6f5b1d tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Request method failure captured: Jun 01 04:29:05.338060 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: request: GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 HTTP/1.1 Jun 01 04:29:05.338060 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept: application/json Jun 01 04:29:05.338060 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept-Encoding: identity Jun 01 04:29:05.338060 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Connection: close Jun 01 04:29:05.338060 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Length: 0 Jun 01 04:29:05.338060 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Type: application/json Jun 01 04:29:05.338060 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Host: 10.222.0.18 Jun 01 04:29:05.338060 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Openstack-System-Scope: None Jun 01 04:29:05.338060 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: User-Agent: python-urllib3/1.26.9 Jun 01 04:29:05.338060 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Auth-Token: gAAAAABiluqyG9XF8qSxIUN3TFmjk6eg79rCGaY-g92UiT08JZxMXeKCL5CqlAOWtG2ztoXLc0Or839t70C6avZqPc9mPG2uzOWhaOEFT9Rz1YySzhjARzvXAD2qRYn5e8TMIPiOEdo5hGAQ5KX82JwUbvdIWK__duoZRR8N0NRaH-H_IKUXAto Jun 01 04:29:05.338060 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Id: None Jun 01 04:29:05.338060 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Name: None Jun 01 04:29:05.338060 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Identity-Status: Confirmed Jun 01 04:29:05.338060 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Is-Admin-Project: True Jun 01 04:29:05.338060 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Id: default Jun 01 04:29:05.338060 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Name: Default Jun 01 04:29:05.338060 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Id: 8eb15379902c4745a1e3fd5b83d0e4be Jun 01 04:29:05.338060 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Name: tempest-DeleteServersTestJSON-895117407 Jun 01 04:29:05.338060 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Role: reader,member Jun 01 04:29:05.338060 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Roles: reader,member Jun 01 04:29:05.339709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8eb15379902c4745a1e3fd5b83d0e4be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8eb15379902c4745a1e3fd5b83d0e4be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8eb15379902c4745a1e3fd5b83d0e4be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8eb15379902c4745a1e3fd5b83d0e4be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:29:05.339709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant: tempest-DeleteServersTestJSON-895117407 Jun 01 04:29:05.339709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Id: 8eb15379902c4745a1e3fd5b83d0e4be Jun 01 04:29:05.339709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Name: tempest-DeleteServersTestJSON-895117407 Jun 01 04:29:05.339709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User: tempest-DeleteServersTestJSON-895117407-project Jun 01 04:29:05.339709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Id: default Jun 01 04:29:05.339709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Name: Default Jun 01 04:29:05.339709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Id: c2eb70d1582b4876931f05cd4015a346 Jun 01 04:29:05.339709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Name: tempest-DeleteServersTestJSON-895117407-project Jun 01 04:29:05.339709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: method: > Jun 01 04:29:05.339709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: exception: Instance bb2f4fea-bee1-42d9-8db6-985d2f390991 could not be found. Jun 01 04:29:05.339709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: action_args: {'id': 'bb2f4fea-bee1-42d9-8db6-985d2f390991'} Jun 01 04:29:05.340560 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:29:05.340560 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:29:05.340560 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:29:05.340560 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:29:05.340560 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:29:05.340560 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:29:05.340560 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:29:05.340560 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:29:05.340560 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:29:05.340560 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:29:05.340560 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb2f4fea-bee1-42d9-8db6-985d2f390991 could not be found. Jun 01 04:29:05.340560 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:29:05.340560 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:29:05.340560 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:29:05.340560 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:29:05.340560 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:29:05.340560 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:29:05.340560 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:29:05.340560 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:29:05.340560 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:29:05.341871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:29:05.341871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 01 04:29:05.341871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 01 04:29:05.341871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:29:05.341871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:29:05.341871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:29:05.341871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:29:05.341871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb2f4fea-bee1-42d9-8db6-985d2f390991 could not be found. Jun 01 04:29:05.341871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:29:05.341871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:29:05.341871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:29:05.341871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:29:05.341871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:29:05.341871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:29:05.341871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:29:05.341871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:29:05.341871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb2f4fea-bee1-42d9-8db6-985d2f390991 could not be found. Jun 01 04:29:05.341871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:29:05.343048 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b37a2ff3-eb86-4068-8f18-0e563c6f5b1d tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] Returning 404 to user: Instance bb2f4fea-bee1-42d9-8db6-985d2f390991 could not be found. {{(pid=118516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:29:05.343048 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-b37a2ff3-eb86-4068-8f18-0e563c6f5b1d tempest-DeleteServersTestJSON-895117407 tempest-DeleteServersTestJSON-895117407-project] 10.222.0.18 "GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991" status: 404 len: 111 microversion: 2.1 time: 0.030863 Jun 01 04:29:05.343048 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 112/229] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:05 2022] GET /compute/v2.1/servers/bb2f4fea-bee1-42d9-8db6-985d2f390991 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:29:06.262985 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-ede24cc2-455c-4353-8259-837c8768742a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:06.263704 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-ede24cc2-455c-4353-8259-837c8768742a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:06.270113 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ede24cc2-455c-4353-8259-837c8768742a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:06.271155 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ede24cc2-455c-4353-8259-837c8768742a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:06.272062 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ede24cc2-455c-4353-8259-837c8768742a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:06.272674 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ede24cc2-455c-4353-8259-837c8768742a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:06.401538 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-ede24cc2-455c-4353-8259-837c8768742a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:06.408917 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-ede24cc2-455c-4353-8259-837c8768742a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.149685 Jun 01 04:29:06.409666 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 118/230] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:06 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:07.425762 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-6396e242-fa66-43ef-9c52-8fc7fcbfbf6c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:07.426444 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-6396e242-fa66-43ef-9c52-8fc7fcbfbf6c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:07.432771 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6396e242-fa66-43ef-9c52-8fc7fcbfbf6c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:07.433224 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6396e242-fa66-43ef-9c52-8fc7fcbfbf6c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:07.433996 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6396e242-fa66-43ef-9c52-8fc7fcbfbf6c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:07.434431 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6396e242-fa66-43ef-9c52-8fc7fcbfbf6c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:07.571557 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-6396e242-fa66-43ef-9c52-8fc7fcbfbf6c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:07.579327 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-6396e242-fa66-43ef-9c52-8fc7fcbfbf6c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.157319 Jun 01 04:29:07.579909 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 113/231] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:07 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:08.596174 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-9511c406-8cf4-46fe-a34d-4e90c0899ef3 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:08.596777 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-9511c406-8cf4-46fe-a34d-4e90c0899ef3 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:08.602860 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9511c406-8cf4-46fe-a34d-4e90c0899ef3 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:08.603328 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9511c406-8cf4-46fe-a34d-4e90c0899ef3 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:08.604095 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9511c406-8cf4-46fe-a34d-4e90c0899ef3 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:08.604522 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9511c406-8cf4-46fe-a34d-4e90c0899ef3 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:08.748438 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-9511c406-8cf4-46fe-a34d-4e90c0899ef3 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:08.758862 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-9511c406-8cf4-46fe-a34d-4e90c0899ef3 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.166295 Jun 01 04:29:08.760374 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 119/232] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:08 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:09.782430 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-55ec6184-abe6-44d8-90ac-a8687d675ce2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:09.783484 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-55ec6184-abe6-44d8-90ac-a8687d675ce2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:09.799526 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-55ec6184-abe6-44d8-90ac-a8687d675ce2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:09.799981 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-55ec6184-abe6-44d8-90ac-a8687d675ce2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:09.800756 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-55ec6184-abe6-44d8-90ac-a8687d675ce2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:09.804066 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-55ec6184-abe6-44d8-90ac-a8687d675ce2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:10.057142 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-55ec6184-abe6-44d8-90ac-a8687d675ce2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:10.072210 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-55ec6184-abe6-44d8-90ac-a8687d675ce2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.298278 Jun 01 04:29:10.073224 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 114/233] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:09 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:11.091584 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-63733d1e-f83a-4d54-af69-b32d036239ca tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:11.093058 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-63733d1e-f83a-4d54-af69-b32d036239ca tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:11.100778 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-63733d1e-f83a-4d54-af69-b32d036239ca tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:11.101576 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-63733d1e-f83a-4d54-af69-b32d036239ca tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:11.102706 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-63733d1e-f83a-4d54-af69-b32d036239ca tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:11.103280 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-63733d1e-f83a-4d54-af69-b32d036239ca tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:11.298132 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-63733d1e-f83a-4d54-af69-b32d036239ca tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:11.307050 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-63733d1e-f83a-4d54-af69-b32d036239ca tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.220811 Jun 01 04:29:11.307994 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 120/234] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:11 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:12.324790 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d80749a4-056f-4e11-b4e1-2455d1da0c08 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:12.325708 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-d80749a4-056f-4e11-b4e1-2455d1da0c08 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:12.341706 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d80749a4-056f-4e11-b4e1-2455d1da0c08 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:12.343911 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d80749a4-056f-4e11-b4e1-2455d1da0c08 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:12.346490 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d80749a4-056f-4e11-b4e1-2455d1da0c08 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:12.347192 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d80749a4-056f-4e11-b4e1-2455d1da0c08 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:12.791982 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-d80749a4-056f-4e11-b4e1-2455d1da0c08 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:12.807052 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-d80749a4-056f-4e11-b4e1-2455d1da0c08 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.485291 Jun 01 04:29:12.811669 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 115/235] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:12 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:13.826286 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-75775190-ea6c-4f09-b645-b401de982b6a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:13.826991 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-75775190-ea6c-4f09-b645-b401de982b6a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:13.840677 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-75775190-ea6c-4f09-b645-b401de982b6a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:13.840677 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-75775190-ea6c-4f09-b645-b401de982b6a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:13.840677 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-75775190-ea6c-4f09-b645-b401de982b6a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:13.840677 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-75775190-ea6c-4f09-b645-b401de982b6a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:14.099564 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-75775190-ea6c-4f09-b645-b401de982b6a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:14.119563 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-75775190-ea6c-4f09-b645-b401de982b6a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.291023 Jun 01 04:29:14.120942 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 121/236] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:13 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:15.009367 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-3a404ff5-3db4-489f-9843-8990162267e2 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Action: 'create', calling method: .version_select at 0x7ff325a85700>, body: {"keypair": {"name": "tempest-keypair-407470703", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDX8475zNGZNZgZBmHi97/bmiAly3ZimROz6kJg5aDeGy+A4br80VLdQSLxtWOx4qxMDTyRu7bkYIHs9AGxzEuaAXFcFIK9uG2pjmnKKt8rQy0QADCo91oQARaTVcGeCdA=="}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:29:15.025833 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-3a404ff5-3db4-489f-9843-8990162267e2 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Getting quotas for project 89e9dc06c3304c42a7fb6cbed1e357a4. Resources: {'key_pairs'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:29:15.030819 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-3a404ff5-3db4-489f-9843-8990162267e2 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Getting quotas for user a0a147daff9846e699c26259fac4e004 and project 89e9dc06c3304c42a7fb6cbed1e357a4. Resources: {'key_pairs'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:29:15.136062 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-7aef402a-3630-4e2c-8fc6-943cc5bfccf2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:15.136666 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-7aef402a-3630-4e2c-8fc6-943cc5bfccf2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:15.142715 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7aef402a-3630-4e2c-8fc6-943cc5bfccf2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:15.143161 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7aef402a-3630-4e2c-8fc6-943cc5bfccf2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:15.143978 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7aef402a-3630-4e2c-8fc6-943cc5bfccf2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:15.144409 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7aef402a-3630-4e2c-8fc6-943cc5bfccf2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:15.156962 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-3a404ff5-3db4-489f-9843-8990162267e2 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.408231 Jun 01 04:29:15.161517 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 116/237] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jun 1 04:29:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:29:15.476512 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-7aef402a-3630-4e2c-8fc6-943cc5bfccf2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:15.484832 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-7aef402a-3630-4e2c-8fc6-943cc5bfccf2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.352554 Jun 01 04:29:15.485609 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 122/238] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:15 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:29:16.505767 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-c10366f9-7042-431f-af3d-73848dd03a4b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:16.506725 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-c10366f9-7042-431f-af3d-73848dd03a4b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:16.514839 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c10366f9-7042-431f-af3d-73848dd03a4b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:16.516348 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c10366f9-7042-431f-af3d-73848dd03a4b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:16.517548 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c10366f9-7042-431f-af3d-73848dd03a4b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:16.518230 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c10366f9-7042-431f-af3d-73848dd03a4b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:16.702652 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-c10366f9-7042-431f-af3d-73848dd03a4b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:16.738979 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-c10366f9-7042-431f-af3d-73848dd03a4b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.238474 Jun 01 04:29:16.738979 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 117/239] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:16 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:17.756274 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-05dc5d46-6f6b-42aa-a596-b7c2eac70ca2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:17.757463 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-05dc5d46-6f6b-42aa-a596-b7c2eac70ca2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:17.768374 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-05dc5d46-6f6b-42aa-a596-b7c2eac70ca2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:17.768374 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-05dc5d46-6f6b-42aa-a596-b7c2eac70ca2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:17.768374 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-05dc5d46-6f6b-42aa-a596-b7c2eac70ca2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:17.768374 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-05dc5d46-6f6b-42aa-a596-b7c2eac70ca2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:18.084327 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-05dc5d46-6f6b-42aa-a596-b7c2eac70ca2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:18.092134 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-05dc5d46-6f6b-42aa-a596-b7c2eac70ca2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.342041 Jun 01 04:29:18.093316 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 123/240] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:17 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:18.594220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-1472442e-cc46-44ba-940c-4a9fc4c73f2e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-130515182", "imageRef": "14321baa-3ac5-4c53-8054-4945abce5b2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e9688948-1a1c-4b5b-bf21-d65382a9ef23"}], "security_groups": [{"name": "tempest-securitygroup--113838919"}], "key_name": "tempest-keypair-407470703", "user_data": "}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:29:18.729795 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.network.neutron [None req-1472442e-cc46-44ba-940c-4a9fc4c73f2e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] validate_networks() for [('e9688948-1a1c-4b5b-bf21-d65382a9ef23', None, None, None, None, None)] {{(pid=118516) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 01 04:29:19.109379 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-b0e47fcc-3958-43d6-b882-b4e39871ed7d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:19.109983 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-b0e47fcc-3958-43d6-b882-b4e39871ed7d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:19.116307 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b0e47fcc-3958-43d6-b882-b4e39871ed7d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:19.117006 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b0e47fcc-3958-43d6-b882-b4e39871ed7d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:19.117774 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b0e47fcc-3958-43d6-b882-b4e39871ed7d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:19.118369 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b0e47fcc-3958-43d6-b882-b4e39871ed7d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:19.133680 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-1472442e-cc46-44ba-940c-4a9fc4c73f2e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Flavor limits 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 01 04:29:19.134106 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-1472442e-cc46-44ba-940c-4a9fc4c73f2e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Image limits 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 01 04:29:19.134580 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-1472442e-cc46-44ba-940c-4a9fc4c73f2e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Flavor pref 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 01 04:29:19.134994 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-1472442e-cc46-44ba-940c-4a9fc4c73f2e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Image pref 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 01 04:29:19.135447 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-1472442e-cc46-44ba-940c-4a9fc4c73f2e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 01 04:29:19.144657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1472442e-cc46-44ba-940c-4a9fc4c73f2e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:19.145179 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1472442e-cc46-44ba-940c-4a9fc4c73f2e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:19.146555 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1472442e-cc46-44ba-940c-4a9fc4c73f2e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:19.146962 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1472442e-cc46-44ba-940c-4a9fc4c73f2e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:19.165251 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-1472442e-cc46-44ba-940c-4a9fc4c73f2e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Getting quotas for project 89e9dc06c3304c42a7fb6cbed1e357a4. Resources: {'ram', 'instances', 'cores'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:29:19.169372 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-1472442e-cc46-44ba-940c-4a9fc4c73f2e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Getting quotas for user a0a147daff9846e699c26259fac4e004 and project 89e9dc06c3304c42a7fb6cbed1e357a4. Resources: {'ram', 'instances', 'cores'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:29:19.191743 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-1472442e-cc46-44ba-940c-4a9fc4c73f2e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Going to run 1 instances... {{(pid=118516) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 01 04:29:19.194167 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-1472442e-cc46-44ba-940c-4a9fc4c73f2e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14321baa-3ac5-4c53-8054-4945abce5b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 01 04:29:19.273239 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-b0e47fcc-3958-43d6-b882-b4e39871ed7d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:19.280995 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-b0e47fcc-3958-43d6-b882-b4e39871ed7d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.175737 Jun 01 04:29:19.281569 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 124/241] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:19 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:29:19.338585 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-1472442e-cc46-44ba-940c-4a9fc4c73f2e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.748648 Jun 01 04:29:19.339392 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 118/242] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 1 04:29:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 01 04:29:19.350729 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-54996548-7f43-4d17-9e04-a683c4e5ebb8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:19.351624 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-54996548-7f43-4d17-9e04-a683c4e5ebb8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:19.411991 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-54996548-7f43-4d17-9e04-a683c4e5ebb8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:19.418787 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-54996548-7f43-4d17-9e04-a683c4e5ebb8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1236 microversion: 2.1 time: 0.072899 Jun 01 04:29:19.419578 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 125/243] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:19 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1236 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:20.298635 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-5c07e4bb-e4bd-431a-83dd-a96bbadeb603 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:20.299151 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-5c07e4bb-e4bd-431a-83dd-a96bbadeb603 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:20.306166 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5c07e4bb-e4bd-431a-83dd-a96bbadeb603 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:20.306616 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5c07e4bb-e4bd-431a-83dd-a96bbadeb603 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:20.309813 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5c07e4bb-e4bd-431a-83dd-a96bbadeb603 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:20.309813 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5c07e4bb-e4bd-431a-83dd-a96bbadeb603 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:20.436231 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-7ec535a8-37c8-419d-aa1c-50e27cf677d7 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:20.436851 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-7ec535a8-37c8-419d-aa1c-50e27cf677d7 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:20.438404 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-5c07e4bb-e4bd-431a-83dd-a96bbadeb603 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:20.443627 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7ec535a8-37c8-419d-aa1c-50e27cf677d7 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:20.447546 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7ec535a8-37c8-419d-aa1c-50e27cf677d7 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:20.447546 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7ec535a8-37c8-419d-aa1c-50e27cf677d7 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:20.447546 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7ec535a8-37c8-419d-aa1c-50e27cf677d7 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:20.447807 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-5c07e4bb-e4bd-431a-83dd-a96bbadeb603 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.152310 Jun 01 04:29:20.447807 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 119/244] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:20 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:20.513504 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-7ec535a8-37c8-419d-aa1c-50e27cf677d7 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:20.521115 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-7ec535a8-37c8-419d-aa1c-50e27cf677d7 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1240 microversion: 2.1 time: 0.088904 Jun 01 04:29:20.521679 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 126/245] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:20 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1240 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:29:21.465053 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-7d6d02da-feb3-4191-956a-69259ca47aff tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:21.465826 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-7d6d02da-feb3-4191-956a-69259ca47aff tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:21.474078 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7d6d02da-feb3-4191-956a-69259ca47aff tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:21.474516 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7d6d02da-feb3-4191-956a-69259ca47aff tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:21.475357 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7d6d02da-feb3-4191-956a-69259ca47aff tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:21.475797 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7d6d02da-feb3-4191-956a-69259ca47aff tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:21.539525 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-783a865a-8e69-4774-830c-4ee4ad0056a8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:21.540399 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-783a865a-8e69-4774-830c-4ee4ad0056a8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:21.554908 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-783a865a-8e69-4774-830c-4ee4ad0056a8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:21.555847 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-783a865a-8e69-4774-830c-4ee4ad0056a8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:21.556832 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-783a865a-8e69-4774-830c-4ee4ad0056a8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:21.557280 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-783a865a-8e69-4774-830c-4ee4ad0056a8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:21.637593 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-783a865a-8e69-4774-830c-4ee4ad0056a8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:21.647487 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-783a865a-8e69-4774-830c-4ee4ad0056a8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1240 microversion: 2.1 time: 0.112796 Jun 01 04:29:21.648573 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 127/246] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:21 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1240 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:29:21.711225 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-7d6d02da-feb3-4191-956a-69259ca47aff tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:21.726371 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-7d6d02da-feb3-4191-956a-69259ca47aff tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.265550 Jun 01 04:29:21.726982 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 120/247] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:21 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:22.672402 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-57229fcb-8ef3-41fa-b9b5-e84f7ee9d301 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:22.673019 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-57229fcb-8ef3-41fa-b9b5-e84f7ee9d301 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:22.679277 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-57229fcb-8ef3-41fa-b9b5-e84f7ee9d301 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:22.679761 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-57229fcb-8ef3-41fa-b9b5-e84f7ee9d301 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:22.680526 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-57229fcb-8ef3-41fa-b9b5-e84f7ee9d301 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:22.680994 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-57229fcb-8ef3-41fa-b9b5-e84f7ee9d301 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:22.742660 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-57229fcb-8ef3-41fa-b9b5-e84f7ee9d301 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:22.744011 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-c007cb41-9cee-4f25-b385-e6a5fad607fc tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:22.744651 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-c007cb41-9cee-4f25-b385-e6a5fad607fc tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:22.750851 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-57229fcb-8ef3-41fa-b9b5-e84f7ee9d301 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1232 microversion: 2.1 time: 0.082330 Jun 01 04:29:22.753181 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 128/248] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:22 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1232 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:22.762034 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c007cb41-9cee-4f25-b385-e6a5fad607fc tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:22.762034 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c007cb41-9cee-4f25-b385-e6a5fad607fc tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:22.762034 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c007cb41-9cee-4f25-b385-e6a5fad607fc tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:22.762034 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c007cb41-9cee-4f25-b385-e6a5fad607fc tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:22.890511 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-c007cb41-9cee-4f25-b385-e6a5fad607fc tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:22.900143 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-c007cb41-9cee-4f25-b385-e6a5fad607fc tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1522 microversion: 2.1 time: 0.159926 Jun 01 04:29:22.900726 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 121/249] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:22 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:29:23.775617 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-058c7ba0-a24d-4173-95ae-196228e41451 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:23.776361 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-058c7ba0-a24d-4173-95ae-196228e41451 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:23.783871 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-058c7ba0-a24d-4173-95ae-196228e41451 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:23.783871 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-058c7ba0-a24d-4173-95ae-196228e41451 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:23.784372 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-058c7ba0-a24d-4173-95ae-196228e41451 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:23.784821 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-058c7ba0-a24d-4173-95ae-196228e41451 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:23.855415 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-058c7ba0-a24d-4173-95ae-196228e41451 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:23.864087 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-058c7ba0-a24d-4173-95ae-196228e41451 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1296 microversion: 2.1 time: 0.093850 Jun 01 04:29:23.864645 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 129/250] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:23 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1296 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:23.917461 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-99d16247-f428-48a2-b9a2-ed6a5a59520d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:23.918348 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-99d16247-f428-48a2-b9a2-ed6a5a59520d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:23.924902 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-99d16247-f428-48a2-b9a2-ed6a5a59520d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:23.925466 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-99d16247-f428-48a2-b9a2-ed6a5a59520d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:23.926353 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-99d16247-f428-48a2-b9a2-ed6a5a59520d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:23.926803 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-99d16247-f428-48a2-b9a2-ed6a5a59520d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:24.108335 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-99d16247-f428-48a2-b9a2-ed6a5a59520d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:24.117236 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-99d16247-f428-48a2-b9a2-ed6a5a59520d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1502 microversion: 2.1 time: 0.203559 Jun 01 04:29:24.117814 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 122/251] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:23 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1502 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:24.133192 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-86281d85-de1f-4d7a-b560-06301b75feaa tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:24.133802 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-86281d85-de1f-4d7a-b560-06301b75feaa tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:24.139855 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-86281d85-de1f-4d7a-b560-06301b75feaa tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:24.140308 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-86281d85-de1f-4d7a-b560-06301b75feaa tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:24.141077 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-86281d85-de1f-4d7a-b560-06301b75feaa tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:24.141521 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-86281d85-de1f-4d7a-b560-06301b75feaa tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:24.159622 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=100 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:24.299248 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-86281d85-de1f-4d7a-b560-06301b75feaa tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:24.308054 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-86281d85-de1f-4d7a-b560-06301b75feaa tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1515 microversion: 2.1 time: 0.178431 Jun 01 04:29:24.310359 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 130/252] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:24 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1515 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:24.881718 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-c848ce59-d192-4d47-8bc4-a2e613e28d9a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:24.882591 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-c848ce59-d192-4d47-8bc4-a2e613e28d9a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:24.889873 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c848ce59-d192-4d47-8bc4-a2e613e28d9a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:24.890340 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c848ce59-d192-4d47-8bc4-a2e613e28d9a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:24.891131 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c848ce59-d192-4d47-8bc4-a2e613e28d9a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:24.891639 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c848ce59-d192-4d47-8bc4-a2e613e28d9a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:25.125584 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-c848ce59-d192-4d47-8bc4-a2e613e28d9a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:25.135154 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-c848ce59-d192-4d47-8bc4-a2e613e28d9a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1361 microversion: 2.1 time: 0.257951 Jun 01 04:29:25.135779 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 123/253] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:24 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1361 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:26.153945 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-51a446d4-742f-4636-bb6e-8375fda560fc tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:26.155144 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-51a446d4-742f-4636-bb6e-8375fda560fc tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:26.167815 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-51a446d4-742f-4636-bb6e-8375fda560fc tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:26.168267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-51a446d4-742f-4636-bb6e-8375fda560fc tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:26.169816 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-51a446d4-742f-4636-bb6e-8375fda560fc tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:26.170581 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-51a446d4-742f-4636-bb6e-8375fda560fc tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:26.352805 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-51a446d4-742f-4636-bb6e-8375fda560fc tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:26.362876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-51a446d4-742f-4636-bb6e-8375fda560fc tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1361 microversion: 2.1 time: 0.213998 Jun 01 04:29:26.363693 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 131/254] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:26 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1361 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:26.414715 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-9cc40e61-142c-4304-afe0-ebbf53d2ead2 req-35f392db-1d8b-4c44-a455-dfc25cc0adf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5d63ef9-2dd3-490e-8a17-895f7b2c3b95", "tag": "c19ca474-59d8-487c-9b33-f1c1452fe94d"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:29:26.424913 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-9cc40e61-142c-4304-afe0-ebbf53d2ead2 req-35f392db-1d8b-4c44-a455-dfc25cc0adf7 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:26.425502 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-9cc40e61-142c-4304-afe0-ebbf53d2ead2 req-35f392db-1d8b-4c44-a455-dfc25cc0adf7 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:26.448497 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-9cc40e61-142c-4304-afe0-ebbf53d2ead2 req-35f392db-1d8b-4c44-a455-dfc25cc0adf7 service nova] Creating event network-changed:c19ca474-59d8-487c-9b33-f1c1452fe94d for instance f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 on hv-cinder-66710 Jun 01 04:29:26.453899 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-9cc40e61-142c-4304-afe0-ebbf53d2ead2 req-35f392db-1d8b-4c44-a455-dfc25cc0adf7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043574 Jun 01 04:29:26.454924 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 124/255] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:29:27.385475 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-9454ba19-a86b-419e-9c9b-8730fcb1d9ed tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:27.387028 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-9454ba19-a86b-419e-9c9b-8730fcb1d9ed tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:27.420276 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9454ba19-a86b-419e-9c9b-8730fcb1d9ed tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:27.420845 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9454ba19-a86b-419e-9c9b-8730fcb1d9ed tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:27.424956 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9454ba19-a86b-419e-9c9b-8730fcb1d9ed tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:27.427569 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d93c9c8b-dc09-4721-9897-de9c2ace8e0d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:29:27.428901 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9454ba19-a86b-419e-9c9b-8730fcb1d9ed tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:27.430328 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-d93c9c8b-dc09-4721-9897-de9c2ace8e0d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:27.441492 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d93c9c8b-dc09-4721-9897-de9c2ace8e0d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:27.444963 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d93c9c8b-dc09-4721-9897-de9c2ace8e0d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:27.444963 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d93c9c8b-dc09-4721-9897-de9c2ace8e0d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:27.444963 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d93c9c8b-dc09-4721-9897-de9c2ace8e0d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:27.482699 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.objects.instance [None req-d93c9c8b-dc09-4721-9897-de9c2ace8e0d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lazy-loading 'flavor' on Instance uuid 0c4e6883-b6b6-408f-adb7-2b29610a2150 {{(pid=118516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:29:27.793756 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-9454ba19-a86b-419e-9c9b-8730fcb1d9ed tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:27.802387 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-9454ba19-a86b-419e-9c9b-8730fcb1d9ed tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1361 microversion: 2.1 time: 0.425493 Jun 01 04:29:27.803205 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 132/256] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:27 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1361 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:27.953675 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-d93c9c8b-dc09-4721-9897-de9c2ace8e0d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "POST /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150/action" status: 200 len: 32 microversion: 2.1 time: 0.540848 Jun 01 04:29:27.954341 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 125/257] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 1 04:29:27 2022] POST /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150/action => generated 32 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 01 04:29:27.964265 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a0a2ac2d-96b3-4b3c-8ff0-3018fe9ba94e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:27.964861 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-a0a2ac2d-96b3-4b3c-8ff0-3018fe9ba94e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:27.973560 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a0a2ac2d-96b3-4b3c-8ff0-3018fe9ba94e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:27.974135 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a0a2ac2d-96b3-4b3c-8ff0-3018fe9ba94e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:27.975653 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a0a2ac2d-96b3-4b3c-8ff0-3018fe9ba94e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:27.976095 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a0a2ac2d-96b3-4b3c-8ff0-3018fe9ba94e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:28.134410 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-a0a2ac2d-96b3-4b3c-8ff0-3018fe9ba94e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:28.142020 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-a0a2ac2d-96b3-4b3c-8ff0-3018fe9ba94e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1521 microversion: 2.1 time: 0.181575 Jun 01 04:29:28.142818 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 133/258] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:27 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:28.820475 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-0b782ecc-3bb3-42fb-af47-4f2f4ba62d14 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:28.822692 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-0b782ecc-3bb3-42fb-af47-4f2f4ba62d14 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:28.832019 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0b782ecc-3bb3-42fb-af47-4f2f4ba62d14 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:28.833364 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0b782ecc-3bb3-42fb-af47-4f2f4ba62d14 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:28.834345 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0b782ecc-3bb3-42fb-af47-4f2f4ba62d14 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:28.838794 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0b782ecc-3bb3-42fb-af47-4f2f4ba62d14 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:29.011825 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-0b782ecc-3bb3-42fb-af47-4f2f4ba62d14 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:29.020521 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-0b782ecc-3bb3-42fb-af47-4f2f4ba62d14 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1361 microversion: 2.1 time: 0.204451 Jun 01 04:29:29.021173 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 126/259] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:28 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1361 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:29.159854 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-f2b2ecb7-c636-4e33-9796-b0ff999833e7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:29.161148 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-f2b2ecb7-c636-4e33-9796-b0ff999833e7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:29.167486 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f2b2ecb7-c636-4e33-9796-b0ff999833e7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:29.167941 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f2b2ecb7-c636-4e33-9796-b0ff999833e7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:29.168728 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f2b2ecb7-c636-4e33-9796-b0ff999833e7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:29.169189 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f2b2ecb7-c636-4e33-9796-b0ff999833e7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:29.341582 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-f2b2ecb7-c636-4e33-9796-b0ff999833e7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:29.353457 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-f2b2ecb7-c636-4e33-9796-b0ff999833e7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1521 microversion: 2.1 time: 0.197691 Jun 01 04:29:29.354048 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 134/260] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:29 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:30.037509 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-45bd7318-b341-4d42-9896-bc42ac9b3bb8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:30.038284 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-45bd7318-b341-4d42-9896-bc42ac9b3bb8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:30.040580 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell0:SELECT=2 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:30.041400 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell0:SELECT=10 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:30.047706 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-45bd7318-b341-4d42-9896-bc42ac9b3bb8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:30.048279 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-45bd7318-b341-4d42-9896-bc42ac9b3bb8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:30.049391 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-45bd7318-b341-4d42-9896-bc42ac9b3bb8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:30.049924 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-45bd7318-b341-4d42-9896-bc42ac9b3bb8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:30.196987 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-45bd7318-b341-4d42-9896-bc42ac9b3bb8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:30.207106 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-45bd7318-b341-4d42-9896-bc42ac9b3bb8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1361 microversion: 2.1 time: 0.174038 Jun 01 04:29:30.208347 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 127/261] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:30 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:30.371487 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-86cbfff3-5d60-4c55-95d1-5bf05da230d6 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:30.372097 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-86cbfff3-5d60-4c55-95d1-5bf05da230d6 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:30.374994 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell0:SELECT=2 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:30.378492 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-86cbfff3-5d60-4c55-95d1-5bf05da230d6 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:30.378935 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-86cbfff3-5d60-4c55-95d1-5bf05da230d6 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:30.379919 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-86cbfff3-5d60-4c55-95d1-5bf05da230d6 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:30.380463 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-86cbfff3-5d60-4c55-95d1-5bf05da230d6 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:30.539228 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-86cbfff3-5d60-4c55-95d1-5bf05da230d6 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:30.548142 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-86cbfff3-5d60-4c55-95d1-5bf05da230d6 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1521 microversion: 2.1 time: 0.180550 Jun 01 04:29:30.548719 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 135/262] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:30 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:30.696573 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-8dc12461-f813-4397-8bd9-75aa5f01bca1 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1304300528", "imageRef": "14321baa-3ac5-4c53-8054-4945abce5b2d", "flavorRef": "452"}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:29:30.767763 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.network.neutron [None req-8dc12461-f813-4397-8bd9-75aa5f01bca1 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] validate_networks() for None {{(pid=118516) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 01 04:29:31.172594 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-8dc12461-f813-4397-8bd9-75aa5f01bca1 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Flavor limits 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 01 04:29:31.173121 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-8dc12461-f813-4397-8bd9-75aa5f01bca1 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Image limits 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 01 04:29:31.173465 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-8dc12461-f813-4397-8bd9-75aa5f01bca1 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Flavor pref 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 01 04:29:31.173869 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-8dc12461-f813-4397-8bd9-75aa5f01bca1 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Image pref 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 01 04:29:31.174276 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-8dc12461-f813-4397-8bd9-75aa5f01bca1 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 01 04:29:31.186970 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8dc12461-f813-4397-8bd9-75aa5f01bca1 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:31.187276 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8dc12461-f813-4397-8bd9-75aa5f01bca1 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:31.188110 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8dc12461-f813-4397-8bd9-75aa5f01bca1 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:31.188547 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8dc12461-f813-4397-8bd9-75aa5f01bca1 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:31.226629 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-879fdaba-cec1-4939-ae0e-2df43c99a1e8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:31.228632 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-879fdaba-cec1-4939-ae0e-2df43c99a1e8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:31.244235 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-879fdaba-cec1-4939-ae0e-2df43c99a1e8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:31.244699 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-879fdaba-cec1-4939-ae0e-2df43c99a1e8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:31.245537 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-879fdaba-cec1-4939-ae0e-2df43c99a1e8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:31.245928 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-879fdaba-cec1-4939-ae0e-2df43c99a1e8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:31.248011 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-8dc12461-f813-4397-8bd9-75aa5f01bca1 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Getting quotas for project e2080f03ddd148889160f6f51aa71955. Resources: {'ram', 'instances', 'cores'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:29:31.258862 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-8dc12461-f813-4397-8bd9-75aa5f01bca1 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Getting quotas for user be19da315701413e810d6e1274b36f2b and project e2080f03ddd148889160f6f51aa71955. Resources: {'ram', 'instances', 'cores'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:29:31.294029 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-8dc12461-f813-4397-8bd9-75aa5f01bca1 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Going to run 1 instances... {{(pid=118516) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 01 04:29:31.298703 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-8dc12461-f813-4397-8bd9-75aa5f01bca1 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14321baa-3ac5-4c53-8054-4945abce5b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 01 04:29:31.435777 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-879fdaba-cec1-4939-ae0e-2df43c99a1e8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:31.443909 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-879fdaba-cec1-4939-ae0e-2df43c99a1e8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1361 microversion: 2.1 time: 0.222988 Jun 01 04:29:31.444486 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 136/263] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:31 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1361 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:31.490905 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-8dc12461-f813-4397-8bd9-75aa5f01bca1 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.799234 Jun 01 04:29:31.491747 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 128/264] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 1 04:29:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 01 04:29:31.501713 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-9887ef05-3daf-44ed-9860-f71434021479 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:31.502680 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-9887ef05-3daf-44ed-9860-f71434021479 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:31.573714 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-67e82f6a-4ccc-4270-80db-91ed9220b127 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:31.574478 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-67e82f6a-4ccc-4270-80db-91ed9220b127 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:31.582407 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-67e82f6a-4ccc-4270-80db-91ed9220b127 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:31.583105 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-67e82f6a-4ccc-4270-80db-91ed9220b127 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:31.585480 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-67e82f6a-4ccc-4270-80db-91ed9220b127 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:31.585480 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-67e82f6a-4ccc-4270-80db-91ed9220b127 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:31.592919 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-9887ef05-3daf-44ed-9860-f71434021479 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:31.610728 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:31.615090 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-9887ef05-3daf-44ed-9860-f71434021479 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1215 microversion: 2.1 time: 0.111152 Jun 01 04:29:31.616214 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 137/265] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:31 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1215 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:31.786616 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-67e82f6a-4ccc-4270-80db-91ed9220b127 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:31.791418 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-67e82f6a-4ccc-4270-80db-91ed9220b127 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1521 microversion: 2.1 time: 0.221404 Jun 01 04:29:31.792104 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 129/266] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:31 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:32.461427 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-f1db2760-e7c6-4c36-a2bc-379adcfa0863 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:32.466096 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-f1db2760-e7c6-4c36-a2bc-379adcfa0863 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:32.466096 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_api:SELECT=50 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:32.470125 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f1db2760-e7c6-4c36-a2bc-379adcfa0863 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:32.470590 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f1db2760-e7c6-4c36-a2bc-379adcfa0863 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:32.471746 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f1db2760-e7c6-4c36-a2bc-379adcfa0863 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:32.472326 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f1db2760-e7c6-4c36-a2bc-379adcfa0863 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:32.627325 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-f1db2760-e7c6-4c36-a2bc-379adcfa0863 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:32.640881 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d4575601-5dde-40b1-9b3d-c6843d4d9420 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:32.641496 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-d4575601-5dde-40b1-9b3d-c6843d4d9420 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:32.646926 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-f1db2760-e7c6-4c36-a2bc-379adcfa0863 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1361 microversion: 2.1 time: 0.189615 Jun 01 04:29:32.646926 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 138/267] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:32 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1361 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:32.703064 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-d4575601-5dde-40b1-9b3d-c6843d4d9420 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:32.710247 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-d4575601-5dde-40b1-9b3d-c6843d4d9420 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1215 microversion: 2.1 time: 0.075439 Jun 01 04:29:32.712820 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 130/268] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:32 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1215 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:32.808710 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-40053120-0cc1-47ff-9e83-934d77b5d5b0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:32.809319 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-40053120-0cc1-47ff-9e83-934d77b5d5b0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:32.815367 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-40053120-0cc1-47ff-9e83-934d77b5d5b0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:32.815814 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-40053120-0cc1-47ff-9e83-934d77b5d5b0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:32.816564 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-40053120-0cc1-47ff-9e83-934d77b5d5b0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:32.818473 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-40053120-0cc1-47ff-9e83-934d77b5d5b0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:32.963590 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-40053120-0cc1-47ff-9e83-934d77b5d5b0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:32.972215 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-40053120-0cc1-47ff-9e83-934d77b5d5b0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1521 microversion: 2.1 time: 0.168080 Jun 01 04:29:32.972949 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 139/269] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:32 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:33.666381 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-2d078027-5a4f-44a2-b3db-50b15322c9fe tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:33.667094 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-2d078027-5a4f-44a2-b3db-50b15322c9fe tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:33.669610 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=7 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:33.675200 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2d078027-5a4f-44a2-b3db-50b15322c9fe tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:33.675671 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2d078027-5a4f-44a2-b3db-50b15322c9fe tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:33.677026 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2d078027-5a4f-44a2-b3db-50b15322c9fe tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:33.677473 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2d078027-5a4f-44a2-b3db-50b15322c9fe tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:33.745115 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-ee2ac32c-6567-4090-ab49-2db9c8560b58 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:33.746559 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-ee2ac32c-6567-4090-ab49-2db9c8560b58 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:33.757204 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ee2ac32c-6567-4090-ab49-2db9c8560b58 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:33.757891 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ee2ac32c-6567-4090-ab49-2db9c8560b58 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:33.758772 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ee2ac32c-6567-4090-ab49-2db9c8560b58 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:33.759509 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ee2ac32c-6567-4090-ab49-2db9c8560b58 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:33.837300 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-2d078027-5a4f-44a2-b3db-50b15322c9fe tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:33.847239 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-2d078027-5a4f-44a2-b3db-50b15322c9fe tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1361 microversion: 2.1 time: 0.184489 Jun 01 04:29:33.857982 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 131/270] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:33 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1361 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:33.858165 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-ee2ac32c-6567-4090-ab49-2db9c8560b58 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:33.870076 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-ee2ac32c-6567-4090-ab49-2db9c8560b58 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1211 microversion: 2.1 time: 0.131393 Jun 01 04:29:33.870076 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 140/271] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:33 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1211 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:29:33.990981 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-82f19276-2004-4af6-8bac-f5c80bc2f9d1 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:33.991534 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-82f19276-2004-4af6-8bac-f5c80bc2f9d1 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:33.998494 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-82f19276-2004-4af6-8bac-f5c80bc2f9d1 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:33.998943 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-82f19276-2004-4af6-8bac-f5c80bc2f9d1 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:33.999733 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-82f19276-2004-4af6-8bac-f5c80bc2f9d1 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:34.000172 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-82f19276-2004-4af6-8bac-f5c80bc2f9d1 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:34.159888 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-82f19276-2004-4af6-8bac-f5c80bc2f9d1 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:34.176725 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-82f19276-2004-4af6-8bac-f5c80bc2f9d1 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1521 microversion: 2.1 time: 0.189522 Jun 01 04:29:34.177506 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 132/272] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:33 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:34.290913 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-54d5735a-feaa-4910-b2ab-4f6cebd73ec7 req-35408748-7ddc-4770-8427-a34c426dabdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d63ef9-2dd3-490e-8a17-895f7b2c3b95", "name": "network-vif-plugged", "status": "completed", "tag": "c19ca474-59d8-487c-9b33-f1c1452fe94d"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:29:34.299088 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-54d5735a-feaa-4910-b2ab-4f6cebd73ec7 req-35408748-7ddc-4770-8427-a34c426dabdb service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:34.299571 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-54d5735a-feaa-4910-b2ab-4f6cebd73ec7 req-35408748-7ddc-4770-8427-a34c426dabdb service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:34.310718 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-54d5735a-feaa-4910-b2ab-4f6cebd73ec7 req-35408748-7ddc-4770-8427-a34c426dabdb service nova] Creating event network-vif-plugged:c19ca474-59d8-487c-9b33-f1c1452fe94d for instance f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 on hv-cinder-66710 Jun 01 04:29:34.315987 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-54d5735a-feaa-4910-b2ab-4f6cebd73ec7 req-35408748-7ddc-4770-8427-a34c426dabdb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028764 Jun 01 04:29:34.316597 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 141/273] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:29:34.865976 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-4ffda18d-f8d9-4cd6-bab0-b0fef5b5a28b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:34.866590 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-4ffda18d-f8d9-4cd6-bab0-b0fef5b5a28b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:34.872779 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4ffda18d-f8d9-4cd6-bab0-b0fef5b5a28b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:34.873236 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4ffda18d-f8d9-4cd6-bab0-b0fef5b5a28b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:34.874011 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4ffda18d-f8d9-4cd6-bab0-b0fef5b5a28b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:34.874451 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4ffda18d-f8d9-4cd6-bab0-b0fef5b5a28b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:34.889862 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-66ddcf7c-863c-4244-8fa4-563cd0796c69 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:34.891175 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-66ddcf7c-863c-4244-8fa4-563cd0796c69 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:34.900446 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-66ddcf7c-863c-4244-8fa4-563cd0796c69 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:34.901137 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-66ddcf7c-863c-4244-8fa4-563cd0796c69 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:34.901915 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-66ddcf7c-863c-4244-8fa4-563cd0796c69 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:34.902345 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-66ddcf7c-863c-4244-8fa4-563cd0796c69 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:34.978780 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-66ddcf7c-863c-4244-8fa4-563cd0796c69 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:34.987017 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-66ddcf7c-863c-4244-8fa4-563cd0796c69 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1275 microversion: 2.1 time: 0.104311 Jun 01 04:29:34.987636 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 142/274] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:34 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1275 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:29:35.042229 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-4ffda18d-f8d9-4cd6-bab0-b0fef5b5a28b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:35.050611 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-4ffda18d-f8d9-4cd6-bab0-b0fef5b5a28b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1361 microversion: 2.1 time: 0.188632 Jun 01 04:29:35.051252 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 133/275] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:34 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:29:35.199532 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a0678e03-788a-4efd-8769-0feeed6a2f32 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:35.200143 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-a0678e03-788a-4efd-8769-0feeed6a2f32 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:35.206487 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a0678e03-788a-4efd-8769-0feeed6a2f32 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:35.206938 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a0678e03-788a-4efd-8769-0feeed6a2f32 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:35.208264 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a0678e03-788a-4efd-8769-0feeed6a2f32 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:35.208701 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a0678e03-788a-4efd-8769-0feeed6a2f32 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:35.345872 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-a0678e03-788a-4efd-8769-0feeed6a2f32 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:35.354116 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-a0678e03-788a-4efd-8769-0feeed6a2f32 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1521 microversion: 2.1 time: 0.158431 Jun 01 04:29:35.354914 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 143/276] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:35 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:29:36.006351 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-2ed0030c-399f-4333-9b48-1db4de516324 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:36.006978 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-2ed0030c-399f-4333-9b48-1db4de516324 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:36.013826 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2ed0030c-399f-4333-9b48-1db4de516324 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:36.014272 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2ed0030c-399f-4333-9b48-1db4de516324 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:36.015046 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2ed0030c-399f-4333-9b48-1db4de516324 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:36.015515 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2ed0030c-399f-4333-9b48-1db4de516324 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:36.072536 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-02e8322e-2785-462b-b5f0-d43b0b5d68fe tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:36.074511 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-02e8322e-2785-462b-b5f0-d43b0b5d68fe tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:36.086274 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-02e8322e-2785-462b-b5f0-d43b0b5d68fe tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:36.087043 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-2ed0030c-399f-4333-9b48-1db4de516324 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:36.087189 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-02e8322e-2785-462b-b5f0-d43b0b5d68fe tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:36.088495 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-02e8322e-2785-462b-b5f0-d43b0b5d68fe tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:36.089299 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-02e8322e-2785-462b-b5f0-d43b0b5d68fe tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:36.095011 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-2ed0030c-399f-4333-9b48-1db4de516324 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1275 microversion: 2.1 time: 0.093055 Jun 01 04:29:36.095993 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 134/277] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:36 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1275 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:36.256995 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-02e8322e-2785-462b-b5f0-d43b0b5d68fe tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:36.264730 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-02e8322e-2785-462b-b5f0-d43b0b5d68fe tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1361 microversion: 2.1 time: 0.199677 Jun 01 04:29:36.265315 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 144/278] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:36 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1361 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:36.372054 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-e28761ba-c0c6-4e40-a2a8-f858548e1fc4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:36.372666 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-e28761ba-c0c6-4e40-a2a8-f858548e1fc4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:36.378916 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e28761ba-c0c6-4e40-a2a8-f858548e1fc4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:36.379403 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e28761ba-c0c6-4e40-a2a8-f858548e1fc4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:36.380188 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e28761ba-c0c6-4e40-a2a8-f858548e1fc4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:36.380637 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e28761ba-c0c6-4e40-a2a8-f858548e1fc4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:36.517543 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-e28761ba-c0c6-4e40-a2a8-f858548e1fc4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:36.526150 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-e28761ba-c0c6-4e40-a2a8-f858548e1fc4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1521 microversion: 2.1 time: 0.157991 Jun 01 04:29:36.526733 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 135/279] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:36 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:29:37.118709 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-4db17834-a643-4686-aa88-94b8503d09b8 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:37.119369 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-4db17834-a643-4686-aa88-94b8503d09b8 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:37.126084 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4db17834-a643-4686-aa88-94b8503d09b8 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:37.126526 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4db17834-a643-4686-aa88-94b8503d09b8 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:37.127271 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4db17834-a643-4686-aa88-94b8503d09b8 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:37.127962 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4db17834-a643-4686-aa88-94b8503d09b8 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:37.190634 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-4db17834-a643-4686-aa88-94b8503d09b8 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:37.199036 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-4db17834-a643-4686-aa88-94b8503d09b8 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1275 microversion: 2.1 time: 0.084523 Jun 01 04:29:37.199830 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 145/280] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:37 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1275 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:37.284179 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b8b28716-5151-4e7c-95c8-23229ac4e24f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:37.284789 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-b8b28716-5151-4e7c-95c8-23229ac4e24f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:37.291393 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b8b28716-5151-4e7c-95c8-23229ac4e24f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:37.291850 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b8b28716-5151-4e7c-95c8-23229ac4e24f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:37.292616 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b8b28716-5151-4e7c-95c8-23229ac4e24f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:37.293059 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b8b28716-5151-4e7c-95c8-23229ac4e24f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:37.424835 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b8b28716-5151-4e7c-95c8-23229ac4e24f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:37.432718 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-b8b28716-5151-4e7c-95c8-23229ac4e24f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1361 microversion: 2.1 time: 0.152363 Jun 01 04:29:37.433292 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 136/281] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:37 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:37.543908 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-049e7f97-5670-4ee2-8e4d-394f5e53ce4a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:37.544504 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-049e7f97-5670-4ee2-8e4d-394f5e53ce4a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:37.550347 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-049e7f97-5670-4ee2-8e4d-394f5e53ce4a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:37.550794 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-049e7f97-5670-4ee2-8e4d-394f5e53ce4a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:37.552137 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-049e7f97-5670-4ee2-8e4d-394f5e53ce4a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:37.552559 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-049e7f97-5670-4ee2-8e4d-394f5e53ce4a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:37.681411 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-049e7f97-5670-4ee2-8e4d-394f5e53ce4a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:37.689022 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-049e7f97-5670-4ee2-8e4d-394f5e53ce4a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1521 microversion: 2.1 time: 0.149127 Jun 01 04:29:37.689576 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 146/282] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:37 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:38.215292 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-ce12d8fd-fe36-4e43-a7b5-59b49a6a7581 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:38.215934 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-ce12d8fd-fe36-4e43-a7b5-59b49a6a7581 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:38.222192 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ce12d8fd-fe36-4e43-a7b5-59b49a6a7581 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:38.222658 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ce12d8fd-fe36-4e43-a7b5-59b49a6a7581 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:38.223466 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ce12d8fd-fe36-4e43-a7b5-59b49a6a7581 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:38.223908 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ce12d8fd-fe36-4e43-a7b5-59b49a6a7581 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:38.288213 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-ce12d8fd-fe36-4e43-a7b5-59b49a6a7581 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:38.296281 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-ce12d8fd-fe36-4e43-a7b5-59b49a6a7581 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1275 microversion: 2.1 time: 0.084937 Jun 01 04:29:38.296854 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 137/283] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:38 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1275 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:38.449101 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-f0345ada-f4a4-4b08-bc5b-27563abf2661 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:38.449702 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-f0345ada-f4a4-4b08-bc5b-27563abf2661 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:38.455789 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f0345ada-f4a4-4b08-bc5b-27563abf2661 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:38.456237 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f0345ada-f4a4-4b08-bc5b-27563abf2661 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:38.456997 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f0345ada-f4a4-4b08-bc5b-27563abf2661 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:38.458032 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f0345ada-f4a4-4b08-bc5b-27563abf2661 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:38.600439 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-f0345ada-f4a4-4b08-bc5b-27563abf2661 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:38.609374 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-f0345ada-f4a4-4b08-bc5b-27563abf2661 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1361 microversion: 2.1 time: 0.164092 Jun 01 04:29:38.609928 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 147/284] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:38 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:38.708577 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-fd1bee65-189f-42ba-8963-e34ff2dfdaf4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:38.709429 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-fd1bee65-189f-42ba-8963-e34ff2dfdaf4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:38.717522 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fd1bee65-189f-42ba-8963-e34ff2dfdaf4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:38.718145 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fd1bee65-189f-42ba-8963-e34ff2dfdaf4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:38.719118 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fd1bee65-189f-42ba-8963-e34ff2dfdaf4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:38.719570 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fd1bee65-189f-42ba-8963-e34ff2dfdaf4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:38.859245 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-fd1bee65-189f-42ba-8963-e34ff2dfdaf4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:38.867762 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-fd1bee65-189f-42ba-8963-e34ff2dfdaf4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1521 microversion: 2.1 time: 0.165380 Jun 01 04:29:38.868341 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 138/285] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:38 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:39.313537 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-7021cf06-07ff-4c07-a104-f1eb5306766d tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:39.314151 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-7021cf06-07ff-4c07-a104-f1eb5306766d tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:39.320917 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7021cf06-07ff-4c07-a104-f1eb5306766d tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:39.321327 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7021cf06-07ff-4c07-a104-f1eb5306766d tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:39.322135 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7021cf06-07ff-4c07-a104-f1eb5306766d tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:39.322570 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7021cf06-07ff-4c07-a104-f1eb5306766d tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:39.384875 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-7021cf06-07ff-4c07-a104-f1eb5306766d tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:39.388298 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=100 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:39.392429 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-7021cf06-07ff-4c07-a104-f1eb5306766d tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1285 microversion: 2.1 time: 0.082812 Jun 01 04:29:39.392986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 148/286] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:39 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1285 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:39.626103 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-7d122276-d243-4843-9b62-b4f07a886758 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:39.626736 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-7d122276-d243-4843-9b62-b4f07a886758 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:39.633331 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7d122276-d243-4843-9b62-b4f07a886758 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:39.633708 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7d122276-d243-4843-9b62-b4f07a886758 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:39.634469 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7d122276-d243-4843-9b62-b4f07a886758 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:39.634901 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7d122276-d243-4843-9b62-b4f07a886758 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:39.778131 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-7d122276-d243-4843-9b62-b4f07a886758 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:39.786170 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-7d122276-d243-4843-9b62-b4f07a886758 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1361 microversion: 2.1 time: 0.163352 Jun 01 04:29:39.786730 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 139/287] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:39 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:39.885901 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-7762eef1-9139-4925-a679-7a663b0f3c1f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:39.886453 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-7762eef1-9139-4925-a679-7a663b0f3c1f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:39.892822 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7762eef1-9139-4925-a679-7a663b0f3c1f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:39.893266 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7762eef1-9139-4925-a679-7a663b0f3c1f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:39.894028 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7762eef1-9139-4925-a679-7a663b0f3c1f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:39.894459 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7762eef1-9139-4925-a679-7a663b0f3c1f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:40.046473 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-7762eef1-9139-4925-a679-7a663b0f3c1f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:40.054542 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-7762eef1-9139-4925-a679-7a663b0f3c1f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1521 microversion: 2.1 time: 0.172913 Jun 01 04:29:40.055099 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 149/288] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:39 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:40.412354 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-e951e2ae-db73-4e1b-8e6f-07798f4b6e7e tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:40.412354 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-e951e2ae-db73-4e1b-8e6f-07798f4b6e7e tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:40.418839 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e951e2ae-db73-4e1b-8e6f-07798f4b6e7e tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:40.419296 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e951e2ae-db73-4e1b-8e6f-07798f4b6e7e tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:40.420171 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e951e2ae-db73-4e1b-8e6f-07798f4b6e7e tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:40.420615 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e951e2ae-db73-4e1b-8e6f-07798f4b6e7e tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:40.515573 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-e951e2ae-db73-4e1b-8e6f-07798f4b6e7e tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:40.527222 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-e951e2ae-db73-4e1b-8e6f-07798f4b6e7e tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1273 microversion: 2.1 time: 0.120828 Jun 01 04:29:40.528226 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 140/289] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:40 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1273 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:40.803179 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-e457e642-0f73-42e6-9acf-bf4ae9db4786 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:40.803753 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-e457e642-0f73-42e6-9acf-bf4ae9db4786 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:40.812080 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e457e642-0f73-42e6-9acf-bf4ae9db4786 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:40.813090 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e457e642-0f73-42e6-9acf-bf4ae9db4786 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:40.815770 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e457e642-0f73-42e6-9acf-bf4ae9db4786 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:40.815770 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e457e642-0f73-42e6-9acf-bf4ae9db4786 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:41.009655 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-e457e642-0f73-42e6-9acf-bf4ae9db4786 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:41.018374 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-e457e642-0f73-42e6-9acf-bf4ae9db4786 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1361 microversion: 2.1 time: 0.219609 Jun 01 04:29:41.018374 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 150/290] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:40 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1361 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:41.072398 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-1b85e19b-5695-4e2c-ba3a-809d8f97213c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:41.073127 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-1b85e19b-5695-4e2c-ba3a-809d8f97213c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:41.079753 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1b85e19b-5695-4e2c-ba3a-809d8f97213c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:41.080289 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1b85e19b-5695-4e2c-ba3a-809d8f97213c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:41.081269 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1b85e19b-5695-4e2c-ba3a-809d8f97213c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:41.081781 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1b85e19b-5695-4e2c-ba3a-809d8f97213c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:41.211582 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell0:SELECT=2 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:41.408070 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-1b85e19b-5695-4e2c-ba3a-809d8f97213c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:41.417127 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-1b85e19b-5695-4e2c-ba3a-809d8f97213c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1521 microversion: 2.1 time: 0.348464 Jun 01 04:29:41.417796 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 141/291] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:41 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:41.546122 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-25227d4a-f81e-4bc8-8351-4e53b827cbf0 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:41.546769 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-25227d4a-f81e-4bc8-8351-4e53b827cbf0 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:41.553010 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-25227d4a-f81e-4bc8-8351-4e53b827cbf0 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:41.553459 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-25227d4a-f81e-4bc8-8351-4e53b827cbf0 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:41.554259 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-25227d4a-f81e-4bc8-8351-4e53b827cbf0 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:41.554871 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-25227d4a-f81e-4bc8-8351-4e53b827cbf0 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:41.600995 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell0:SELECT=2 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:41.740419 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-25227d4a-f81e-4bc8-8351-4e53b827cbf0 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:41.759050 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-25227d4a-f81e-4bc8-8351-4e53b827cbf0 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1315 microversion: 2.1 time: 0.206849 Jun 01 04:29:41.759050 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 151/292] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:41 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:42.039818 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-f5c98b95-dd74-4975-9efa-3dffae5c66cb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:42.044561 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-f5c98b95-dd74-4975-9efa-3dffae5c66cb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:42.061797 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f5c98b95-dd74-4975-9efa-3dffae5c66cb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:42.062609 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f5c98b95-dd74-4975-9efa-3dffae5c66cb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:42.064263 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f5c98b95-dd74-4975-9efa-3dffae5c66cb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:42.064935 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f5c98b95-dd74-4975-9efa-3dffae5c66cb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:42.241119 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-88794af9-cc00-436e-af9a-b9a6acdea2b8 req-29c26e63-cc8d-4b6b-8cff-82f2ccd5b811 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f96372c5-5ef6-48d0-b54e-5baa275732bf", "tag": "e77f53f2-afd9-4725-9f83-6d76a6786cce"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:29:42.261105 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-88794af9-cc00-436e-af9a-b9a6acdea2b8 req-29c26e63-cc8d-4b6b-8cff-82f2ccd5b811 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:42.262876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-88794af9-cc00-436e-af9a-b9a6acdea2b8 req-29c26e63-cc8d-4b6b-8cff-82f2ccd5b811 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:42.293605 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-88794af9-cc00-436e-af9a-b9a6acdea2b8 req-29c26e63-cc8d-4b6b-8cff-82f2ccd5b811 service nova] Creating event network-changed:e77f53f2-afd9-4725-9f83-6d76a6786cce for instance f96372c5-5ef6-48d0-b54e-5baa275732bf on hv-cinder-66710 Jun 01 04:29:42.314046 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-88794af9-cc00-436e-af9a-b9a6acdea2b8 req-29c26e63-cc8d-4b6b-8cff-82f2ccd5b811 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073129 Jun 01 04:29:42.314649 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 152/293] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:29:42.322934 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-f5c98b95-dd74-4975-9efa-3dffae5c66cb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:42.337034 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-f5c98b95-dd74-4975-9efa-3dffae5c66cb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1361 microversion: 2.1 time: 0.303452 Jun 01 04:29:42.337034 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 142/294] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:42 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1361 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:29:42.440552 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-9e6307a2-2d09-4e61-bd5d-d442babb9682 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:42.446183 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-9e6307a2-2d09-4e61-bd5d-d442babb9682 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:42.449484 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9e6307a2-2d09-4e61-bd5d-d442babb9682 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:42.451226 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9e6307a2-2d09-4e61-bd5d-d442babb9682 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:42.452245 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9e6307a2-2d09-4e61-bd5d-d442babb9682 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:42.452839 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9e6307a2-2d09-4e61-bd5d-d442babb9682 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:42.636309 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-9e6307a2-2d09-4e61-bd5d-d442babb9682 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:42.644396 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-9e6307a2-2d09-4e61-bd5d-d442babb9682 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1521 microversion: 2.1 time: 0.212178 Jun 01 04:29:42.650381 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 153/295] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:42 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:42.772327 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-23f7eecb-7a0a-4d07-b197-b7a04de01788 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:42.773273 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-23f7eecb-7a0a-4d07-b197-b7a04de01788 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:42.775287 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell0:SELECT=8 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:42.781780 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-23f7eecb-7a0a-4d07-b197-b7a04de01788 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:42.781988 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-23f7eecb-7a0a-4d07-b197-b7a04de01788 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:42.782909 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-23f7eecb-7a0a-4d07-b197-b7a04de01788 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:42.783143 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-23f7eecb-7a0a-4d07-b197-b7a04de01788 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:43.003790 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-23f7eecb-7a0a-4d07-b197-b7a04de01788 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:43.012197 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-23f7eecb-7a0a-4d07-b197-b7a04de01788 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1315 microversion: 2.1 time: 0.249609 Jun 01 04:29:43.012778 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 143/296] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:42 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:43.354560 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-142d68c4-1c46-4dc0-959f-7d519bf59b3d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:43.355716 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-142d68c4-1c46-4dc0-959f-7d519bf59b3d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:43.370673 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-142d68c4-1c46-4dc0-959f-7d519bf59b3d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:43.370673 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-142d68c4-1c46-4dc0-959f-7d519bf59b3d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:43.370673 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-142d68c4-1c46-4dc0-959f-7d519bf59b3d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:43.370673 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-142d68c4-1c46-4dc0-959f-7d519bf59b3d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:43.511553 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-142d68c4-1c46-4dc0-959f-7d519bf59b3d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:43.519061 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-142d68c4-1c46-4dc0-959f-7d519bf59b3d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1547 microversion: 2.1 time: 0.169048 Jun 01 04:29:43.520444 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 154/297] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:43 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1547 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:43.537202 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-6fc965fa-5cff-4f7a-9b17-189a5ea01c2c tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:43.537714 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-6fc965fa-5cff-4f7a-9b17-189a5ea01c2c tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:43.544982 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6fc965fa-5cff-4f7a-9b17-189a5ea01c2c tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:43.545441 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6fc965fa-5cff-4f7a-9b17-189a5ea01c2c tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:43.546230 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6fc965fa-5cff-4f7a-9b17-189a5ea01c2c tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:43.546666 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6fc965fa-5cff-4f7a-9b17-189a5ea01c2c tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:43.634349 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-6fc965fa-5cff-4f7a-9b17-189a5ea01c2c tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102030 Jun 01 04:29:43.640441 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 144/298] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Jun 1 04:29:43 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:29:43.666023 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-fc3e45f9-979a-4507-9699-6b740586d466 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:43.666991 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-fc3e45f9-979a-4507-9699-6b740586d466 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:43.674137 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-fc3e45f9-979a-4507-9699-6b740586d466 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:43.675764 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-fc3e45f9-979a-4507-9699-6b740586d466 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:43.676388 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-fc3e45f9-979a-4507-9699-6b740586d466 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:43.677426 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-fc3e45f9-979a-4507-9699-6b740586d466 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:43.941365 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-fc3e45f9-979a-4507-9699-6b740586d466 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:43.948856 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-fc3e45f9-979a-4507-9699-6b740586d466 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1521 microversion: 2.1 time: 0.286762 Jun 01 04:29:43.949411 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 155/299] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:43 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:44.032614 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-1679d101-3959-4c59-b4c2-9faa9ac543b0 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:44.033492 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-1679d101-3959-4c59-b4c2-9faa9ac543b0 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:44.042458 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1679d101-3959-4c59-b4c2-9faa9ac543b0 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:44.043071 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1679d101-3959-4c59-b4c2-9faa9ac543b0 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:44.044046 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1679d101-3959-4c59-b4c2-9faa9ac543b0 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:44.044612 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1679d101-3959-4c59-b4c2-9faa9ac543b0 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:44.217638 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-1679d101-3959-4c59-b4c2-9faa9ac543b0 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:44.238281 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-1679d101-3959-4c59-b4c2-9faa9ac543b0 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1315 microversion: 2.1 time: 0.210131 Jun 01 04:29:44.243155 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 145/300] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:44 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:44.817719 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-3c352f2b-1bd7-463b-ae05-cb09731cb271 req-36754901-804a-4d51-b991-73eee95461c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5d63ef9-2dd3-490e-8a17-895f7b2c3b95", "tag": "c19ca474-59d8-487c-9b33-f1c1452fe94d"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:29:44.850076 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-3c352f2b-1bd7-463b-ae05-cb09731cb271 req-36754901-804a-4d51-b991-73eee95461c0 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:44.850505 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-3c352f2b-1bd7-463b-ae05-cb09731cb271 req-36754901-804a-4d51-b991-73eee95461c0 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:44.877995 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-3c352f2b-1bd7-463b-ae05-cb09731cb271 req-36754901-804a-4d51-b991-73eee95461c0 service nova] Creating event network-changed:c19ca474-59d8-487c-9b33-f1c1452fe94d for instance f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 on hv-cinder-66710 Jun 01 04:29:44.889392 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-3c352f2b-1bd7-463b-ae05-cb09731cb271 req-36754901-804a-4d51-b991-73eee95461c0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080355 Jun 01 04:29:44.891886 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 156/301] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:29:44.972441 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-fa3dab7f-395a-4057-a729-b5e88ce583cb tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:44.973666 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-fa3dab7f-395a-4057-a729-b5e88ce583cb tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:44.993958 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fa3dab7f-395a-4057-a729-b5e88ce583cb tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:44.995900 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fa3dab7f-395a-4057-a729-b5e88ce583cb tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:45.000679 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fa3dab7f-395a-4057-a729-b5e88ce583cb tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:45.001168 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fa3dab7f-395a-4057-a729-b5e88ce583cb tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:45.260479 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-6fcbc660-18fd-4328-a625-a7585c438d02 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:45.262746 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-6fcbc660-18fd-4328-a625-a7585c438d02 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:45.282388 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6fcbc660-18fd-4328-a625-a7585c438d02 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:45.282858 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6fcbc660-18fd-4328-a625-a7585c438d02 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:45.283687 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6fcbc660-18fd-4328-a625-a7585c438d02 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:45.284123 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6fcbc660-18fd-4328-a625-a7585c438d02 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:45.550347 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-fa3dab7f-395a-4057-a729-b5e88ce583cb tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:45.561485 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-fa3dab7f-395a-4057-a729-b5e88ce583cb tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1521 microversion: 2.1 time: 0.597069 Jun 01 04:29:45.570701 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 146/302] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:44 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1521 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:45.630170 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-6fcbc660-18fd-4328-a625-a7585c438d02 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:45.652622 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-6fcbc660-18fd-4328-a625-a7585c438d02 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1315 microversion: 2.1 time: 0.399163 Jun 01 04:29:45.653837 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 157/303] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:45 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:46.579399 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-cfc26794-996a-4223-b2e3-8a4b4c7dc06b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:46.580159 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-cfc26794-996a-4223-b2e3-8a4b4c7dc06b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:46.591589 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cfc26794-996a-4223-b2e3-8a4b4c7dc06b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:46.592530 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cfc26794-996a-4223-b2e3-8a4b4c7dc06b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:46.593617 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cfc26794-996a-4223-b2e3-8a4b4c7dc06b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:46.594441 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cfc26794-996a-4223-b2e3-8a4b4c7dc06b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:46.618784 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=100 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:46.677428 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-4fb8c452-7b82-4aad-b0da-7f7c06caea22 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:46.679442 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-4fb8c452-7b82-4aad-b0da-7f7c06caea22 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:46.688493 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4fb8c452-7b82-4aad-b0da-7f7c06caea22 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:46.689475 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4fb8c452-7b82-4aad-b0da-7f7c06caea22 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:46.690276 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4fb8c452-7b82-4aad-b0da-7f7c06caea22 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:46.690901 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4fb8c452-7b82-4aad-b0da-7f7c06caea22 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:46.765101 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-cfc26794-996a-4223-b2e3-8a4b4c7dc06b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:46.773300 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-cfc26794-996a-4223-b2e3-8a4b4c7dc06b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1521 microversion: 2.1 time: 0.197834 Jun 01 04:29:46.773880 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 147/304] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:46 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:29:46.853984 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-4fb8c452-7b82-4aad-b0da-7f7c06caea22 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:46.861020 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-4fb8c452-7b82-4aad-b0da-7f7c06caea22 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1315 microversion: 2.1 time: 0.193264 Jun 01 04:29:46.861594 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 158/305] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:46 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:29:47.790683 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-2f6219d0-813e-43e1-8100-b808e4fad6e1 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:47.791322 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-2f6219d0-813e-43e1-8100-b808e4fad6e1 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:47.798792 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2f6219d0-813e-43e1-8100-b808e4fad6e1 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:47.799731 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2f6219d0-813e-43e1-8100-b808e4fad6e1 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:47.800761 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2f6219d0-813e-43e1-8100-b808e4fad6e1 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:47.801365 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2f6219d0-813e-43e1-8100-b808e4fad6e1 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:47.886233 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a8c63541-107c-4db9-a337-20788fbedab0 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:47.886640 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-a8c63541-107c-4db9-a337-20788fbedab0 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:47.892837 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a8c63541-107c-4db9-a337-20788fbedab0 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:47.893367 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a8c63541-107c-4db9-a337-20788fbedab0 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:47.894152 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a8c63541-107c-4db9-a337-20788fbedab0 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:47.894776 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a8c63541-107c-4db9-a337-20788fbedab0 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:47.960364 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-2f6219d0-813e-43e1-8100-b808e4fad6e1 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:47.976544 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-2f6219d0-813e-43e1-8100-b808e4fad6e1 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1521 microversion: 2.1 time: 0.189361 Jun 01 04:29:47.977174 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 148/306] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:47 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:48.066015 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-a8c63541-107c-4db9-a337-20788fbedab0 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:48.074135 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-a8c63541-107c-4db9-a337-20788fbedab0 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1315 microversion: 2.1 time: 0.192496 Jun 01 04:29:48.074707 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 159/307] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:47 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:29:48.994579 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-f75aca65-1153-4b8a-b626-b85384b1f879 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:48.995183 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-f75aca65-1153-4b8a-b626-b85384b1f879 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:49.001882 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f75aca65-1153-4b8a-b626-b85384b1f879 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:49.002330 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f75aca65-1153-4b8a-b626-b85384b1f879 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:49.003091 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f75aca65-1153-4b8a-b626-b85384b1f879 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:49.003545 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f75aca65-1153-4b8a-b626-b85384b1f879 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:49.098202 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-5a6b71c7-ce97-4bb5-a7a9-e7c1f230bf0f tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:49.098848 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-5a6b71c7-ce97-4bb5-a7a9-e7c1f230bf0f tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:49.105074 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5a6b71c7-ce97-4bb5-a7a9-e7c1f230bf0f tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:49.105525 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5a6b71c7-ce97-4bb5-a7a9-e7c1f230bf0f tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:49.106460 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5a6b71c7-ce97-4bb5-a7a9-e7c1f230bf0f tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:49.106893 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5a6b71c7-ce97-4bb5-a7a9-e7c1f230bf0f tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:49.141678 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-f75aca65-1153-4b8a-b626-b85384b1f879 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:49.160249 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-f75aca65-1153-4b8a-b626-b85384b1f879 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1521 microversion: 2.1 time: 0.169409 Jun 01 04:29:49.161066 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 149/308] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:48 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:49.265959 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-5a6b71c7-ce97-4bb5-a7a9-e7c1f230bf0f tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:49.274874 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-5a6b71c7-ce97-4bb5-a7a9-e7c1f230bf0f tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1315 microversion: 2.1 time: 0.180555 Jun 01 04:29:49.275569 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 160/309] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:49 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:29:50.177355 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-aa75c0d4-bfca-418f-8a3a-76759f041938 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:50.177968 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-aa75c0d4-bfca-418f-8a3a-76759f041938 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:50.184620 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-aa75c0d4-bfca-418f-8a3a-76759f041938 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:50.185072 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-aa75c0d4-bfca-418f-8a3a-76759f041938 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:50.185876 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-aa75c0d4-bfca-418f-8a3a-76759f041938 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:50.186588 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-aa75c0d4-bfca-418f-8a3a-76759f041938 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:50.293197 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-0c754cd5-327c-4e99-9740-6d3952a24750 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:50.294624 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-0c754cd5-327c-4e99-9740-6d3952a24750 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:50.304864 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0c754cd5-327c-4e99-9740-6d3952a24750 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:50.304864 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0c754cd5-327c-4e99-9740-6d3952a24750 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:50.304864 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0c754cd5-327c-4e99-9740-6d3952a24750 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:50.309126 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0c754cd5-327c-4e99-9740-6d3952a24750 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:50.387067 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-aa75c0d4-bfca-418f-8a3a-76759f041938 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:50.395356 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-aa75c0d4-bfca-418f-8a3a-76759f041938 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1521 microversion: 2.1 time: 0.221790 Jun 01 04:29:50.397605 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 150/310] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:50 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:50.496604 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-0c754cd5-327c-4e99-9740-6d3952a24750 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:50.504490 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-0c754cd5-327c-4e99-9740-6d3952a24750 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1315 microversion: 2.1 time: 0.214976 Jun 01 04:29:50.505081 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 161/311] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:50 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:51.415451 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-ad590d35-232c-4f20-be8f-0c15e45763bb tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:51.416067 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-ad590d35-232c-4f20-be8f-0c15e45763bb tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:51.422619 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ad590d35-232c-4f20-be8f-0c15e45763bb tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:51.423066 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ad590d35-232c-4f20-be8f-0c15e45763bb tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:51.423873 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ad590d35-232c-4f20-be8f-0c15e45763bb tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:51.424300 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ad590d35-232c-4f20-be8f-0c15e45763bb tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:51.522624 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-810a0b44-99eb-4e23-901b-8e6344942562 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:51.523621 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-810a0b44-99eb-4e23-901b-8e6344942562 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:51.531511 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-810a0b44-99eb-4e23-901b-8e6344942562 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:51.532057 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-810a0b44-99eb-4e23-901b-8e6344942562 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:51.533152 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-810a0b44-99eb-4e23-901b-8e6344942562 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:51.533597 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-810a0b44-99eb-4e23-901b-8e6344942562 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:51.566555 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-ad590d35-232c-4f20-be8f-0c15e45763bb tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:51.576480 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-ad590d35-232c-4f20-be8f-0c15e45763bb tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1501 microversion: 2.1 time: 0.165092 Jun 01 04:29:51.577067 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 151/312] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:51 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1501 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:51.593962 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-db8a4039-ab65-405e-abaa-8d011dcab81b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0f5ccab-c1c2-43a8-bb6a-0e335330138c"}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:29:51.595098 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-db8a4039-ab65-405e-abaa-8d011dcab81b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:51.602436 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-db8a4039-ab65-405e-abaa-8d011dcab81b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:51.602884 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-db8a4039-ab65-405e-abaa-8d011dcab81b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:51.603936 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-db8a4039-ab65-405e-abaa-8d011dcab81b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:51.604383 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-db8a4039-ab65-405e-abaa-8d011dcab81b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:51.633943 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.wsgi [None req-db8a4039-ab65-405e-abaa-8d011dcab81b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] HTTP exception thrown: Cannot 'attach_volume' instance 0c4e6883-b6b6-408f-adb7-2b29610a2150 while it is in vm_state rescued Jun 01 04:29:51.635884 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-db8a4039-ab65-405e-abaa-8d011dcab81b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Request method failure captured: Jun 01 04:29:51.635884 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: request: POST /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150/os-volume_attachments HTTP/1.1 Jun 01 04:29:51.635884 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept: application/json Jun 01 04:29:51.635884 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept-Encoding: identity Jun 01 04:29:51.635884 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Connection: close Jun 01 04:29:51.635884 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Length: 74 Jun 01 04:29:51.635884 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Type: application/json Jun 01 04:29:51.635884 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Host: 10.222.0.18 Jun 01 04:29:51.635884 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Openstack-System-Scope: None Jun 01 04:29:51.635884 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: User-Agent: python-urllib3/1.26.9 Jun 01 04:29:51.635884 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Auth-Token: gAAAAABiluq6EdglhZgXiS3poHNwL1UUlx7ueC5joJlWhxd9bYUqBcVhkRgghCVJtLC4e0wLqyaT33kVSWKLZMbzDI4PfCEcbl3WeLPmp8XhZ65e-9_afNsqAcBGQuzFEA_cFCtrXjwsuFGgJBYRijSPhwsG4KkGPRwDtmJAygQq6VRDVmLA8kk Jun 01 04:29:51.635884 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Id: None Jun 01 04:29:51.635884 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Name: None Jun 01 04:29:51.635884 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Identity-Status: Confirmed Jun 01 04:29:51.635884 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Is-Admin-Project: True Jun 01 04:29:51.635884 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Id: default Jun 01 04:29:51.635884 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Name: Default Jun 01 04:29:51.635884 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Id: bda53dca70e54e208b2767a833923234 Jun 01 04:29:51.635884 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-788108745 Jun 01 04:29:51.635884 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Role: reader,member Jun 01 04:29:51.635884 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Roles: reader,member Jun 01 04:29:51.637370 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bda53dca70e54e208b2767a833923234"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bda53dca70e54e208b2767a833923234"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bda53dca70e54e208b2767a833923234"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bda53dca70e54e208b2767a833923234"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:29:51.637370 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant: tempest-ServerRescueNegativeTestJSON-788108745 Jun 01 04:29:51.637370 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Id: bda53dca70e54e208b2767a833923234 Jun 01 04:29:51.637370 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-788108745 Jun 01 04:29:51.637370 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User: tempest-ServerRescueNegativeTestJSON-788108745-project Jun 01 04:29:51.637370 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Id: default Jun 01 04:29:51.637370 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Name: Default Jun 01 04:29:51.637370 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Id: 12816eca659542af9e41b92fdb674eab Jun 01 04:29:51.637370 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Name: tempest-ServerRescueNegativeTestJSON-788108745-project Jun 01 04:29:51.637370 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Jun 01 04:29:51.637370 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: {"volumeAttachment": {"volumeId": "f0f5ccab-c1c2-43a8-bb6a-0e335330138c"}} Jun 01 04:29:51.637370 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: method: > Jun 01 04:29:51.638202 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: exception: Cannot 'attach_volume' instance 0c4e6883-b6b6-408f-adb7-2b29610a2150 while it is in vm_state rescued Jun 01 04:29:51.638202 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: action_args: {'server_id': '0c4e6883-b6b6-408f-adb7-2b29610a2150', 'body': {'volumeAttachment': {'volumeId': 'f0f5ccab-c1c2-43a8-bb6a-0e335330138c'}}} Jun 01 04:29:51.638202 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:29:51.638202 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:29:51.638202 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 01 04:29:51.638202 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 01 04:29:51.638202 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 01 04:29:51.638202 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 01 04:29:51.638202 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 01 04:29:51.638202 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 01 04:29:51.638202 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0c4e6883-b6b6-408f-adb7-2b29610a2150 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 01 04:29:51.638202 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:29:51.638202 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:29:51.638202 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:29:51.638202 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:29:51.638202 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:29:51.638202 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:29:51.638202 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:29:51.638202 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:29:51.639535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:29:51.639535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:29:51.639535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 01 04:29:51.639535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 01 04:29:51.639535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 01 04:29:51.639535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 01 04:29:51.639535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 01 04:29:51.639535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 01 04:29:51.639535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 01 04:29:51.639535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 01 04:29:51.639535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 01 04:29:51.639535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 01 04:29:51.639535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 0c4e6883-b6b6-408f-adb7-2b29610a2150 while it is in vm_state rescued Jun 01 04:29:51.639535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:29:51.639535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:29:51.639535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:29:51.639535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:29:51.639535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:29:51.639535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:29:51.640640 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:29:51.640640 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:29:51.640640 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 0c4e6883-b6b6-408f-adb7-2b29610a2150 while it is in vm_state rescued Jun 01 04:29:51.640640 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:29:51.640640 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-db8a4039-ab65-405e-abaa-8d011dcab81b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Returning 409 to user: Cannot 'attach_volume' instance 0c4e6883-b6b6-408f-adb7-2b29610a2150 while it is in vm_state rescued {{(pid=118516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:29:51.640640 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-db8a4039-ab65-405e-abaa-8d011dcab81b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "POST /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047513 Jun 01 04:29:51.641457 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 152/313] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 1 04:29:51 2022] POST /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150/os-volume_attachments => generated 152 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 01 04:29:51.647586 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-583bbb1e-3fdf-42b7-8980-6a92ca7810d4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:29:51.648133 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-583bbb1e-3fdf-42b7-8980-6a92ca7810d4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:51.655140 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-583bbb1e-3fdf-42b7-8980-6a92ca7810d4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:51.655614 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-583bbb1e-3fdf-42b7-8980-6a92ca7810d4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:51.656389 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-583bbb1e-3fdf-42b7-8980-6a92ca7810d4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:51.659099 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-583bbb1e-3fdf-42b7-8980-6a92ca7810d4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:51.694916 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-810a0b44-99eb-4e23-901b-8e6344942562 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:51.712614 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-810a0b44-99eb-4e23-901b-8e6344942562 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1315 microversion: 2.1 time: 0.184864 Jun 01 04:29:51.713397 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 162/314] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:51 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:29:51.976750 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-583bbb1e-3fdf-42b7-8980-6a92ca7810d4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "POST /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150/action" status: 202 len: 0 microversion: 2.1 time: 0.333488 Jun 01 04:29:51.977425 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 153/315] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 1 04:29:51 2022] POST /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 01 04:29:51.986016 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-ab29d0d4-4a2e-4398-9914-325a7d38940d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:51.986565 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-ab29d0d4-4a2e-4398-9914-325a7d38940d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:51.993196 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ab29d0d4-4a2e-4398-9914-325a7d38940d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:51.993637 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ab29d0d4-4a2e-4398-9914-325a7d38940d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:51.994392 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ab29d0d4-4a2e-4398-9914-325a7d38940d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:51.994817 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ab29d0d4-4a2e-4398-9914-325a7d38940d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:52.386318 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-ab29d0d4-4a2e-4398-9914-325a7d38940d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:52.394177 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-ab29d0d4-4a2e-4398-9914-325a7d38940d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1509 microversion: 2.1 time: 0.412271 Jun 01 04:29:52.395314 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 163/316] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:51 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1509 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:52.459864 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-dabd4508-4ff7-419f-90fc-ee0732cc402e req-cc6ac51d-c6b1-442c-8708-2b12a44196d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f96372c5-5ef6-48d0-b54e-5baa275732bf", "name": "network-vif-plugged", "status": "completed", "tag": "e77f53f2-afd9-4725-9f83-6d76a6786cce"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:29:52.468898 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-dabd4508-4ff7-419f-90fc-ee0732cc402e req-cc6ac51d-c6b1-442c-8708-2b12a44196d3 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:52.469600 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-dabd4508-4ff7-419f-90fc-ee0732cc402e req-cc6ac51d-c6b1-442c-8708-2b12a44196d3 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:52.482392 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-dabd4508-4ff7-419f-90fc-ee0732cc402e req-cc6ac51d-c6b1-442c-8708-2b12a44196d3 service nova] Creating event network-vif-plugged:e77f53f2-afd9-4725-9f83-6d76a6786cce for instance f96372c5-5ef6-48d0-b54e-5baa275732bf on hv-cinder-66710 Jun 01 04:29:52.487554 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-dabd4508-4ff7-419f-90fc-ee0732cc402e req-cc6ac51d-c6b1-442c-8708-2b12a44196d3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032598 Jun 01 04:29:52.488569 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 154/317] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:29:52.729734 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-65de2c9c-6fc7-4251-93bd-cdcb1c853376 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:52.730514 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-65de2c9c-6fc7-4251-93bd-cdcb1c853376 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:52.737361 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-65de2c9c-6fc7-4251-93bd-cdcb1c853376 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:52.737875 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-65de2c9c-6fc7-4251-93bd-cdcb1c853376 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:52.738725 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-65de2c9c-6fc7-4251-93bd-cdcb1c853376 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:52.739227 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-65de2c9c-6fc7-4251-93bd-cdcb1c853376 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:52.888963 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-65de2c9c-6fc7-4251-93bd-cdcb1c853376 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:52.897444 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-65de2c9c-6fc7-4251-93bd-cdcb1c853376 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1315 microversion: 2.1 time: 0.171169 Jun 01 04:29:52.897640 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 164/318] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:52 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:53.413698 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-13e2acf5-e50c-48fe-82a1-2e6998b07800 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:53.414472 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-13e2acf5-e50c-48fe-82a1-2e6998b07800 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:53.421076 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-13e2acf5-e50c-48fe-82a1-2e6998b07800 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:53.421583 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-13e2acf5-e50c-48fe-82a1-2e6998b07800 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:53.423678 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-13e2acf5-e50c-48fe-82a1-2e6998b07800 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:53.423678 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-13e2acf5-e50c-48fe-82a1-2e6998b07800 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:53.580075 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-13e2acf5-e50c-48fe-82a1-2e6998b07800 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:53.584421 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-13e2acf5-e50c-48fe-82a1-2e6998b07800 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1509 microversion: 2.1 time: 0.175342 Jun 01 04:29:53.594081 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 155/319] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:53 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1509 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:53.914413 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-969d41da-a06f-48cc-b7cb-867255555a82 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:53.915013 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-969d41da-a06f-48cc-b7cb-867255555a82 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:53.921390 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-969d41da-a06f-48cc-b7cb-867255555a82 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:53.921842 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-969d41da-a06f-48cc-b7cb-867255555a82 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:53.923185 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-969d41da-a06f-48cc-b7cb-867255555a82 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:53.923185 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-969d41da-a06f-48cc-b7cb-867255555a82 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:54.067621 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-969d41da-a06f-48cc-b7cb-867255555a82 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:54.075608 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-969d41da-a06f-48cc-b7cb-867255555a82 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1315 microversion: 2.1 time: 0.165492 Jun 01 04:29:54.076178 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 165/320] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:53 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:54.603232 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-8f5b5bb4-3847-4dc5-be5a-05b6f8caad31 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:54.603879 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-8f5b5bb4-3847-4dc5-be5a-05b6f8caad31 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:54.611162 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8f5b5bb4-3847-4dc5-be5a-05b6f8caad31 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:54.611663 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8f5b5bb4-3847-4dc5-be5a-05b6f8caad31 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:54.612468 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8f5b5bb4-3847-4dc5-be5a-05b6f8caad31 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:54.612909 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8f5b5bb4-3847-4dc5-be5a-05b6f8caad31 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:54.757937 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-8f5b5bb4-3847-4dc5-be5a-05b6f8caad31 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:54.765526 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-8f5b5bb4-3847-4dc5-be5a-05b6f8caad31 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1509 microversion: 2.1 time: 0.166173 Jun 01 04:29:54.766098 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 156/321] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:54 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:55.092173 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-176ac771-ee6c-4f47-b908-12d7e3db6092 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:55.092748 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-176ac771-ee6c-4f47-b908-12d7e3db6092 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:55.098724 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-176ac771-ee6c-4f47-b908-12d7e3db6092 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:55.099743 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-176ac771-ee6c-4f47-b908-12d7e3db6092 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:55.100499 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-176ac771-ee6c-4f47-b908-12d7e3db6092 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:55.100969 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-176ac771-ee6c-4f47-b908-12d7e3db6092 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:55.244473 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-176ac771-ee6c-4f47-b908-12d7e3db6092 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:55.247996 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=100 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:55.252651 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-176ac771-ee6c-4f47-b908-12d7e3db6092 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1315 microversion: 2.1 time: 0.164102 Jun 01 04:29:55.252954 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 166/322] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:55 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:55.783514 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-0d309c70-be12-4b32-a06d-715398e1ce22 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:55.784119 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-0d309c70-be12-4b32-a06d-715398e1ce22 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:55.791679 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0d309c70-be12-4b32-a06d-715398e1ce22 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:55.792273 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0d309c70-be12-4b32-a06d-715398e1ce22 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:55.793049 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0d309c70-be12-4b32-a06d-715398e1ce22 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:55.793482 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0d309c70-be12-4b32-a06d-715398e1ce22 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:55.938922 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-0d309c70-be12-4b32-a06d-715398e1ce22 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:55.946539 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-0d309c70-be12-4b32-a06d-715398e1ce22 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1509 microversion: 2.1 time: 0.166903 Jun 01 04:29:55.947179 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 157/323] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:55 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:56.269686 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-dfc8a327-6306-47b9-b68d-ece10e5c8d10 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:56.270345 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-dfc8a327-6306-47b9-b68d-ece10e5c8d10 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:56.277047 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-dfc8a327-6306-47b9-b68d-ece10e5c8d10 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:56.277493 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-dfc8a327-6306-47b9-b68d-ece10e5c8d10 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:56.278252 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-dfc8a327-6306-47b9-b68d-ece10e5c8d10 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:56.278688 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-dfc8a327-6306-47b9-b68d-ece10e5c8d10 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:56.424921 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-dfc8a327-6306-47b9-b68d-ece10e5c8d10 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:56.433574 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-dfc8a327-6306-47b9-b68d-ece10e5c8d10 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1315 microversion: 2.1 time: 0.167458 Jun 01 04:29:56.434143 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 167/324] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:56 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:56.964185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-87fdd4fd-3358-417b-8ced-36b90e2a99b2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:56.964818 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-87fdd4fd-3358-417b-8ced-36b90e2a99b2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:56.971447 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-87fdd4fd-3358-417b-8ced-36b90e2a99b2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:56.971911 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-87fdd4fd-3358-417b-8ced-36b90e2a99b2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:56.972760 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-87fdd4fd-3358-417b-8ced-36b90e2a99b2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:56.973208 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-87fdd4fd-3358-417b-8ced-36b90e2a99b2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:57.110489 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-87fdd4fd-3358-417b-8ced-36b90e2a99b2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:57.118427 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-87fdd4fd-3358-417b-8ced-36b90e2a99b2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1509 microversion: 2.1 time: 0.158217 Jun 01 04:29:57.119002 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 158/325] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:56 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:29:57.450860 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-cac7680d-8165-4f60-95d1-532c2ab97892 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:57.451417 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-cac7680d-8165-4f60-95d1-532c2ab97892 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:57.457420 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-cac7680d-8165-4f60-95d1-532c2ab97892 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:57.457860 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-cac7680d-8165-4f60-95d1-532c2ab97892 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:57.458667 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-cac7680d-8165-4f60-95d1-532c2ab97892 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:57.459095 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-cac7680d-8165-4f60-95d1-532c2ab97892 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:57.608926 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-cac7680d-8165-4f60-95d1-532c2ab97892 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:57.617620 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-cac7680d-8165-4f60-95d1-532c2ab97892 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1315 microversion: 2.1 time: 0.170826 Jun 01 04:29:57.618242 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 168/326] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:57 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:58.135682 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-464af431-cc49-4da8-98c9-c8cd5f58118e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:58.136290 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-464af431-cc49-4da8-98c9-c8cd5f58118e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:58.142846 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-464af431-cc49-4da8-98c9-c8cd5f58118e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:58.143292 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-464af431-cc49-4da8-98c9-c8cd5f58118e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:58.144280 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-464af431-cc49-4da8-98c9-c8cd5f58118e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:58.144766 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-464af431-cc49-4da8-98c9-c8cd5f58118e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:58.276287 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-464af431-cc49-4da8-98c9-c8cd5f58118e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:58.284067 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-464af431-cc49-4da8-98c9-c8cd5f58118e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1509 microversion: 2.1 time: 0.152355 Jun 01 04:29:58.284640 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 159/327] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:58 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:58.634162 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-f07d7417-48d4-4d8e-a2f2-f0d20a597754 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:58.634770 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-f07d7417-48d4-4d8e-a2f2-f0d20a597754 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:58.640910 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f07d7417-48d4-4d8e-a2f2-f0d20a597754 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:58.641355 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f07d7417-48d4-4d8e-a2f2-f0d20a597754 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:58.642115 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f07d7417-48d4-4d8e-a2f2-f0d20a597754 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:58.642546 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f07d7417-48d4-4d8e-a2f2-f0d20a597754 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:58.778459 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-f07d7417-48d4-4d8e-a2f2-f0d20a597754 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:58.786079 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-f07d7417-48d4-4d8e-a2f2-f0d20a597754 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1315 microversion: 2.1 time: 0.155830 Jun 01 04:29:58.786633 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 169/328] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:58 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:59.301546 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-306ca5df-953d-4a33-874f-510d06fae845 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:59.302750 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-306ca5df-953d-4a33-874f-510d06fae845 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:59.309781 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-306ca5df-953d-4a33-874f-510d06fae845 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:59.310230 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-306ca5df-953d-4a33-874f-510d06fae845 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:59.310996 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-306ca5df-953d-4a33-874f-510d06fae845 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:59.311454 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-306ca5df-953d-4a33-874f-510d06fae845 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:59.452015 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-306ca5df-953d-4a33-874f-510d06fae845 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:59.459675 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-306ca5df-953d-4a33-874f-510d06fae845 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1509 microversion: 2.1 time: 0.161923 Jun 01 04:29:59.460239 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 160/329] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:59 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:29:59.803338 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-8383a231-e50d-4d99-b225-2f1f8193d6fa tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:29:59.803969 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-8383a231-e50d-4d99-b225-2f1f8193d6fa tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:29:59.810323 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8383a231-e50d-4d99-b225-2f1f8193d6fa tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:59.810771 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8383a231-e50d-4d99-b225-2f1f8193d6fa tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:59.811636 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8383a231-e50d-4d99-b225-2f1f8193d6fa tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:29:59.812067 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8383a231-e50d-4d99-b225-2f1f8193d6fa tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:29:59.942679 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-8383a231-e50d-4d99-b225-2f1f8193d6fa tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:29:59.950786 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-8383a231-e50d-4d99-b225-2f1f8193d6fa tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1315 microversion: 2.1 time: 0.151719 Jun 01 04:29:59.951375 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 170/330] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:29:59 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:00.761203 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-403c2597-3f2d-456e-8a06-b9a9efd3ab95 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:00.761203 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-403c2597-3f2d-456e-8a06-b9a9efd3ab95 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:00.761203 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-403c2597-3f2d-456e-8a06-b9a9efd3ab95 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:00.761203 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-403c2597-3f2d-456e-8a06-b9a9efd3ab95 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:00.761848 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-403c2597-3f2d-456e-8a06-b9a9efd3ab95 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:00.761848 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-403c2597-3f2d-456e-8a06-b9a9efd3ab95 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:00.761848 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-403c2597-3f2d-456e-8a06-b9a9efd3ab95 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:00.762093 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-403c2597-3f2d-456e-8a06-b9a9efd3ab95 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1509 microversion: 2.1 time: 0.159518 Jun 01 04:30:00.762093 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 161/331] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:00 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:00.968126 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-95b55a9f-6801-458e-91b8-dafb893250fb tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:00.969363 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-95b55a9f-6801-458e-91b8-dafb893250fb tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:00.975592 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-95b55a9f-6801-458e-91b8-dafb893250fb tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:00.982659 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-95b55a9f-6801-458e-91b8-dafb893250fb tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:00.982659 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-95b55a9f-6801-458e-91b8-dafb893250fb tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:00.982659 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-95b55a9f-6801-458e-91b8-dafb893250fb tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:01.123448 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-95b55a9f-6801-458e-91b8-dafb893250fb tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:01.131006 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-95b55a9f-6801-458e-91b8-dafb893250fb tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1315 microversion: 2.1 time: 0.166784 Jun 01 04:30:01.131598 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 171/332] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:00 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:01.777732 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-919c43ce-0454-4a09-a213-19f0b06b8d7e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:01.778537 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-919c43ce-0454-4a09-a213-19f0b06b8d7e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:01.785275 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-919c43ce-0454-4a09-a213-19f0b06b8d7e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:01.785721 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-919c43ce-0454-4a09-a213-19f0b06b8d7e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:01.786556 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-919c43ce-0454-4a09-a213-19f0b06b8d7e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:01.786992 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-919c43ce-0454-4a09-a213-19f0b06b8d7e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:01.946812 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-919c43ce-0454-4a09-a213-19f0b06b8d7e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:01.954589 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-919c43ce-0454-4a09-a213-19f0b06b8d7e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1509 microversion: 2.1 time: 0.182099 Jun 01 04:30:01.955172 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 162/333] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:01 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1509 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:02.148504 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-1745a507-18be-4a20-828f-036ced5de75f tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:02.149142 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-1745a507-18be-4a20-828f-036ced5de75f tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:02.155518 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1745a507-18be-4a20-828f-036ced5de75f tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:02.155969 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1745a507-18be-4a20-828f-036ced5de75f tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:02.156736 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1745a507-18be-4a20-828f-036ced5de75f tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:02.157381 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1745a507-18be-4a20-828f-036ced5de75f tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:02.299562 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-1745a507-18be-4a20-828f-036ced5de75f tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:02.308724 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-1745a507-18be-4a20-828f-036ced5de75f tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1315 microversion: 2.1 time: 0.164606 Jun 01 04:30:02.309301 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 172/334] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:02 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:02.972267 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-9e0f4df2-f8fa-4e3c-af34-733853160f18 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:02.972806 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-9e0f4df2-f8fa-4e3c-af34-733853160f18 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:02.980917 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9e0f4df2-f8fa-4e3c-af34-733853160f18 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:02.981415 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9e0f4df2-f8fa-4e3c-af34-733853160f18 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:02.982463 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9e0f4df2-f8fa-4e3c-af34-733853160f18 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:02.982903 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9e0f4df2-f8fa-4e3c-af34-733853160f18 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:03.112010 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-9e0f4df2-f8fa-4e3c-af34-733853160f18 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:03.119627 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-9e0f4df2-f8fa-4e3c-af34-733853160f18 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1509 microversion: 2.1 time: 0.151484 Jun 01 04:30:03.120193 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 163/335] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:02 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:03.326638 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-9c1a71ee-f034-4959-bebe-bc5fa5203f4b tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:03.327774 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-9c1a71ee-f034-4959-bebe-bc5fa5203f4b tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:03.329336 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_api:SELECT=70 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:30:03.335341 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9c1a71ee-f034-4959-bebe-bc5fa5203f4b tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:03.335942 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9c1a71ee-f034-4959-bebe-bc5fa5203f4b tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:03.336732 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9c1a71ee-f034-4959-bebe-bc5fa5203f4b tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:03.337161 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9c1a71ee-f034-4959-bebe-bc5fa5203f4b tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:03.468345 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-9c1a71ee-f034-4959-bebe-bc5fa5203f4b tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:03.476716 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-9c1a71ee-f034-4959-bebe-bc5fa5203f4b tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1315 microversion: 2.1 time: 0.153951 Jun 01 04:30:03.477318 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 173/336] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:03 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:04.138113 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-58426b03-0edf-488c-b342-791589799a12 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:04.138697 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-58426b03-0edf-488c-b342-791589799a12 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:04.141270 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_api:SELECT=66 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:30:04.146083 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-58426b03-0edf-488c-b342-791589799a12 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:04.147155 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-58426b03-0edf-488c-b342-791589799a12 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:04.148178 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-58426b03-0edf-488c-b342-791589799a12 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:04.148613 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-58426b03-0edf-488c-b342-791589799a12 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:04.152848 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:30:04.286336 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-58426b03-0edf-488c-b342-791589799a12 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:04.295098 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-58426b03-0edf-488c-b342-791589799a12 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1509 microversion: 2.1 time: 0.161103 Jun 01 04:30:04.295924 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 164/337] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:04 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:04.494474 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-e104d300-8d99-4291-867b-88a551f73dc8 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:04.495042 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-e104d300-8d99-4291-867b-88a551f73dc8 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:04.501224 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e104d300-8d99-4291-867b-88a551f73dc8 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:04.501678 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e104d300-8d99-4291-867b-88a551f73dc8 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:04.502440 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e104d300-8d99-4291-867b-88a551f73dc8 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:04.502875 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e104d300-8d99-4291-867b-88a551f73dc8 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:04.654309 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-e104d300-8d99-4291-867b-88a551f73dc8 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:04.661719 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-e104d300-8d99-4291-867b-88a551f73dc8 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1315 microversion: 2.1 time: 0.171735 Jun 01 04:30:04.662268 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 174/338] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:04 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:05.312889 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-14e5c4fe-7423-4b5e-b749-c4d8b1144191 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:05.313519 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-14e5c4fe-7423-4b5e-b749-c4d8b1144191 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:05.320116 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-14e5c4fe-7423-4b5e-b749-c4d8b1144191 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:05.320567 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-14e5c4fe-7423-4b5e-b749-c4d8b1144191 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:05.321325 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-14e5c4fe-7423-4b5e-b749-c4d8b1144191 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:05.321762 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-14e5c4fe-7423-4b5e-b749-c4d8b1144191 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:05.462504 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-14e5c4fe-7423-4b5e-b749-c4d8b1144191 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:05.470020 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-14e5c4fe-7423-4b5e-b749-c4d8b1144191 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1509 microversion: 2.1 time: 0.161093 Jun 01 04:30:05.470578 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 165/339] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:05 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:05.679577 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-ea367777-49ee-4a9a-b662-b299b87d34ba tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:05.680210 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-ea367777-49ee-4a9a-b662-b299b87d34ba tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:05.686737 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ea367777-49ee-4a9a-b662-b299b87d34ba tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:05.687189 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ea367777-49ee-4a9a-b662-b299b87d34ba tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:05.688113 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ea367777-49ee-4a9a-b662-b299b87d34ba tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:05.688541 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ea367777-49ee-4a9a-b662-b299b87d34ba tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:05.819578 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-ea367777-49ee-4a9a-b662-b299b87d34ba tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:05.827051 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-ea367777-49ee-4a9a-b662-b299b87d34ba tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1315 microversion: 2.1 time: 0.152353 Jun 01 04:30:05.827894 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 175/340] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:05 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:06.488110 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-7a473591-2d03-4a0b-a225-cd2ec0760299 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:06.488736 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-7a473591-2d03-4a0b-a225-cd2ec0760299 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:06.495639 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7a473591-2d03-4a0b-a225-cd2ec0760299 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:06.498521 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7a473591-2d03-4a0b-a225-cd2ec0760299 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:06.498521 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7a473591-2d03-4a0b-a225-cd2ec0760299 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:06.498521 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7a473591-2d03-4a0b-a225-cd2ec0760299 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:06.631201 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-7a473591-2d03-4a0b-a225-cd2ec0760299 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:06.638958 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-7a473591-2d03-4a0b-a225-cd2ec0760299 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1509 microversion: 2.1 time: 0.154739 Jun 01 04:30:06.639543 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 166/341] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:06 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:06.844790 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-94e37a54-e0f3-4b06-8646-12f55c21c965 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:06.845400 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-94e37a54-e0f3-4b06-8646-12f55c21c965 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:06.852068 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-94e37a54-e0f3-4b06-8646-12f55c21c965 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:06.852517 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-94e37a54-e0f3-4b06-8646-12f55c21c965 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:06.853282 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-94e37a54-e0f3-4b06-8646-12f55c21c965 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:06.853728 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-94e37a54-e0f3-4b06-8646-12f55c21c965 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:06.984660 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-94e37a54-e0f3-4b06-8646-12f55c21c965 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:06.992541 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-94e37a54-e0f3-4b06-8646-12f55c21c965 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1315 microversion: 2.1 time: 0.151633 Jun 01 04:30:06.993095 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 176/342] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:06 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:07.656621 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-61ffd177-088a-41f2-af52-2ae42165016b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:07.657226 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-61ffd177-088a-41f2-af52-2ae42165016b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:07.664919 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-61ffd177-088a-41f2-af52-2ae42165016b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:07.665366 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-61ffd177-088a-41f2-af52-2ae42165016b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:07.666274 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-61ffd177-088a-41f2-af52-2ae42165016b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:07.666718 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-61ffd177-088a-41f2-af52-2ae42165016b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:07.799089 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-61ffd177-088a-41f2-af52-2ae42165016b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:07.807139 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-61ffd177-088a-41f2-af52-2ae42165016b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1509 microversion: 2.1 time: 0.154606 Jun 01 04:30:07.807735 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 167/343] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:07 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:08.008886 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-afc50c8e-f8cf-4855-b755-d8dc2a59651d tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:08.009417 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-afc50c8e-f8cf-4855-b755-d8dc2a59651d tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:08.015479 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-afc50c8e-f8cf-4855-b755-d8dc2a59651d tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:08.015926 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-afc50c8e-f8cf-4855-b755-d8dc2a59651d tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:08.016678 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-afc50c8e-f8cf-4855-b755-d8dc2a59651d tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:08.017107 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-afc50c8e-f8cf-4855-b755-d8dc2a59651d tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:08.149815 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-afc50c8e-f8cf-4855-b755-d8dc2a59651d tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:08.157278 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-afc50c8e-f8cf-4855-b755-d8dc2a59651d tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1315 microversion: 2.1 time: 0.152879 Jun 01 04:30:08.157834 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 177/344] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:08 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:08.824253 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-44bbbad1-696d-49e4-9c57-76a07a02649a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:08.832272 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-44bbbad1-696d-49e4-9c57-76a07a02649a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:08.832272 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-44bbbad1-696d-49e4-9c57-76a07a02649a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:08.832272 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-44bbbad1-696d-49e4-9c57-76a07a02649a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:08.832703 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-44bbbad1-696d-49e4-9c57-76a07a02649a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:08.832953 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-44bbbad1-696d-49e4-9c57-76a07a02649a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:08.976882 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-44bbbad1-696d-49e4-9c57-76a07a02649a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:08.984795 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-44bbbad1-696d-49e4-9c57-76a07a02649a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1509 microversion: 2.1 time: 0.164380 Jun 01 04:30:08.985362 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 168/345] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:08 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:09.173959 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-7e0a9cd6-ac8f-4b29-b12d-d24c59c31fe3 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:09.174558 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-7e0a9cd6-ac8f-4b29-b12d-d24c59c31fe3 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:09.180890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7e0a9cd6-ac8f-4b29-b12d-d24c59c31fe3 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:09.181767 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7e0a9cd6-ac8f-4b29-b12d-d24c59c31fe3 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:09.182320 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7e0a9cd6-ac8f-4b29-b12d-d24c59c31fe3 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:09.182754 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7e0a9cd6-ac8f-4b29-b12d-d24c59c31fe3 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:09.313987 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-7e0a9cd6-ac8f-4b29-b12d-d24c59c31fe3 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:09.322006 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-7e0a9cd6-ac8f-4b29-b12d-d24c59c31fe3 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1315 microversion: 2.1 time: 0.151928 Jun 01 04:30:09.322500 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 178/346] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:09 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:10.002018 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-7109d3a0-e71d-421f-8270-7e977a285e3a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:10.002633 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-7109d3a0-e71d-421f-8270-7e977a285e3a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:10.011532 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7109d3a0-e71d-421f-8270-7e977a285e3a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:10.013185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7109d3a0-e71d-421f-8270-7e977a285e3a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:10.013185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7109d3a0-e71d-421f-8270-7e977a285e3a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:10.013185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7109d3a0-e71d-421f-8270-7e977a285e3a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:10.149631 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-7109d3a0-e71d-421f-8270-7e977a285e3a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:10.157697 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-7109d3a0-e71d-421f-8270-7e977a285e3a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1509 microversion: 2.1 time: 0.159131 Jun 01 04:30:10.158266 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 169/347] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:09 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:10.338479 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-659af348-4490-48cb-a7a3-423633df20ed tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:10.339087 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-659af348-4490-48cb-a7a3-423633df20ed tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:10.345349 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-659af348-4490-48cb-a7a3-423633df20ed tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:10.345800 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-659af348-4490-48cb-a7a3-423633df20ed tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:10.346555 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-659af348-4490-48cb-a7a3-423633df20ed tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:10.346982 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-659af348-4490-48cb-a7a3-423633df20ed tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:10.479269 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-659af348-4490-48cb-a7a3-423633df20ed tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:10.487075 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-659af348-4490-48cb-a7a3-423633df20ed tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1465 microversion: 2.1 time: 0.153041 Jun 01 04:30:10.487666 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 179/348] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:10 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1465 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:10.526952 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-c0d002b9-4796-4ca1-b233-98d5eafd666c tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:10.527487 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-c0d002b9-4796-4ca1-b233-98d5eafd666c tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:10.533618 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c0d002b9-4796-4ca1-b233-98d5eafd666c tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:10.534061 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c0d002b9-4796-4ca1-b233-98d5eafd666c tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:10.534819 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c0d002b9-4796-4ca1-b233-98d5eafd666c tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:10.535248 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c0d002b9-4796-4ca1-b233-98d5eafd666c tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:10.559567 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-c0d002b9-4796-4ca1-b233-98d5eafd666c tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Going to try to terminate instance {{(pid=118516) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 01 04:30:10.874418 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-c0d002b9-4796-4ca1-b233-98d5eafd666c tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 204 len: 0 microversion: 2.1 time: 0.350949 Jun 01 04:30:10.875008 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 170/349] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 1 04:30:10 2022] DELETE /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 01 04:30:10.883960 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-2fe52322-047d-4c8f-ab0c-3baf31034df8 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:10.884569 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-2fe52322-047d-4c8f-ab0c-3baf31034df8 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:10.890679 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2fe52322-047d-4c8f-ab0c-3baf31034df8 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:10.891128 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2fe52322-047d-4c8f-ab0c-3baf31034df8 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:10.891929 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2fe52322-047d-4c8f-ab0c-3baf31034df8 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:10.892365 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2fe52322-047d-4c8f-ab0c-3baf31034df8 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:11.023338 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-2fe52322-047d-4c8f-ab0c-3baf31034df8 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:11.031622 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-2fe52322-047d-4c8f-ab0c-3baf31034df8 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1471 microversion: 2.1 time: 0.152049 Jun 01 04:30:11.032249 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 180/350] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:10 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1471 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:30:11.176378 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-879fd77e-0560-43bb-906c-5110d7cf281a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:11.176982 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-879fd77e-0560-43bb-906c-5110d7cf281a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:11.184173 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-879fd77e-0560-43bb-906c-5110d7cf281a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:11.184619 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-879fd77e-0560-43bb-906c-5110d7cf281a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:11.185379 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-879fd77e-0560-43bb-906c-5110d7cf281a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:11.185810 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-879fd77e-0560-43bb-906c-5110d7cf281a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:11.323276 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-879fd77e-0560-43bb-906c-5110d7cf281a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:11.330996 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-879fd77e-0560-43bb-906c-5110d7cf281a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1509 microversion: 2.1 time: 0.159089 Jun 01 04:30:11.331592 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 171/351] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:11 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:12.049660 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-e1d1a103-c0fb-42a8-96b8-a95c2d78a451 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:12.050170 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-e1d1a103-c0fb-42a8-96b8-a95c2d78a451 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:12.056976 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e1d1a103-c0fb-42a8-96b8-a95c2d78a451 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:12.057411 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e1d1a103-c0fb-42a8-96b8-a95c2d78a451 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:12.058167 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e1d1a103-c0fb-42a8-96b8-a95c2d78a451 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:12.058590 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e1d1a103-c0fb-42a8-96b8-a95c2d78a451 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:12.189621 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-e1d1a103-c0fb-42a8-96b8-a95c2d78a451 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:12.197761 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-e1d1a103-c0fb-42a8-96b8-a95c2d78a451 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1471 microversion: 2.1 time: 0.152103 Jun 01 04:30:12.198365 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 181/352] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:12 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1471 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:12.348287 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-42957041-7355-4cf1-8c48-6a5ddbac65f4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:12.348831 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-42957041-7355-4cf1-8c48-6a5ddbac65f4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:12.355592 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-42957041-7355-4cf1-8c48-6a5ddbac65f4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:12.356054 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-42957041-7355-4cf1-8c48-6a5ddbac65f4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:12.356827 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-42957041-7355-4cf1-8c48-6a5ddbac65f4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:12.357534 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-42957041-7355-4cf1-8c48-6a5ddbac65f4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:12.485896 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-42957041-7355-4cf1-8c48-6a5ddbac65f4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:12.493814 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-42957041-7355-4cf1-8c48-6a5ddbac65f4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1509 microversion: 2.1 time: 0.149487 Jun 01 04:30:12.494371 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 172/353] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:12 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:13.216860 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-8119900e-98d7-423f-b324-72cc68c0924d tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:13.217471 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-8119900e-98d7-423f-b324-72cc68c0924d tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:13.223518 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8119900e-98d7-423f-b324-72cc68c0924d tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:13.223967 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8119900e-98d7-423f-b324-72cc68c0924d tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:13.224729 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8119900e-98d7-423f-b324-72cc68c0924d tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:13.225223 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8119900e-98d7-423f-b324-72cc68c0924d tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:13.361169 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-8119900e-98d7-423f-b324-72cc68c0924d tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:13.369098 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-8119900e-98d7-423f-b324-72cc68c0924d tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1471 microversion: 2.1 time: 0.156052 Jun 01 04:30:13.369726 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 182/354] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:13 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:13.510653 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-ffac42b6-57d8-45c6-850f-82ae4400795f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:13.511181 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-ffac42b6-57d8-45c6-850f-82ae4400795f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:13.517732 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ffac42b6-57d8-45c6-850f-82ae4400795f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:13.518179 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ffac42b6-57d8-45c6-850f-82ae4400795f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:13.518941 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ffac42b6-57d8-45c6-850f-82ae4400795f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:13.519414 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ffac42b6-57d8-45c6-850f-82ae4400795f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:13.654686 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-ffac42b6-57d8-45c6-850f-82ae4400795f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:13.662192 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-ffac42b6-57d8-45c6-850f-82ae4400795f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1509 microversion: 2.1 time: 0.155948 Jun 01 04:30:13.662753 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 173/355] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:13 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:14.386774 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-835efb04-b0f7-40cb-a0c5-8a563d365b8d tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:14.387418 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-835efb04-b0f7-40cb-a0c5-8a563d365b8d tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:14.393571 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-835efb04-b0f7-40cb-a0c5-8a563d365b8d tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:14.394022 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-835efb04-b0f7-40cb-a0c5-8a563d365b8d tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:14.394785 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-835efb04-b0f7-40cb-a0c5-8a563d365b8d tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:14.395216 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-835efb04-b0f7-40cb-a0c5-8a563d365b8d tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:14.414359 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=100 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:30:14.534460 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-835efb04-b0f7-40cb-a0c5-8a563d365b8d tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:14.542280 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-835efb04-b0f7-40cb-a0c5-8a563d365b8d tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1471 microversion: 2.1 time: 0.159684 Jun 01 04:30:14.542850 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 183/356] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:14 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:14.679914 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-eec71e8a-a2a1-41d3-be8f-520a194d8244 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:14.680533 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-eec71e8a-a2a1-41d3-be8f-520a194d8244 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:14.687206 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-eec71e8a-a2a1-41d3-be8f-520a194d8244 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:14.687696 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-eec71e8a-a2a1-41d3-be8f-520a194d8244 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:14.688463 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-eec71e8a-a2a1-41d3-be8f-520a194d8244 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:14.688901 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-eec71e8a-a2a1-41d3-be8f-520a194d8244 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:14.834498 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-eec71e8a-a2a1-41d3-be8f-520a194d8244 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:14.842931 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-eec71e8a-a2a1-41d3-be8f-520a194d8244 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1515 microversion: 2.1 time: 0.167345 Jun 01 04:30:14.854031 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 174/357] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:14 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:15.564540 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-3676438b-fb7b-483c-8c84-4b1fe0a9fec4 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:15.565150 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-3676438b-fb7b-483c-8c84-4b1fe0a9fec4 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:15.571804 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3676438b-fb7b-483c-8c84-4b1fe0a9fec4 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:15.572701 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3676438b-fb7b-483c-8c84-4b1fe0a9fec4 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:15.573673 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3676438b-fb7b-483c-8c84-4b1fe0a9fec4 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:15.574291 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3676438b-fb7b-483c-8c84-4b1fe0a9fec4 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:15.723813 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-3676438b-fb7b-483c-8c84-4b1fe0a9fec4 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:15.732593 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-3676438b-fb7b-483c-8c84-4b1fe0a9fec4 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1471 microversion: 2.1 time: 0.176440 Jun 01 04:30:15.733384 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 184/358] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:15 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1471 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:30:16.752854 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-bd416f76-045e-4464-be6e-1af04b762842 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:16.753545 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-bd416f76-045e-4464-be6e-1af04b762842 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:16.761568 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bd416f76-045e-4464-be6e-1af04b762842 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:16.762023 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bd416f76-045e-4464-be6e-1af04b762842 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:16.763965 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bd416f76-045e-4464-be6e-1af04b762842 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:16.764749 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bd416f76-045e-4464-be6e-1af04b762842 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:17.030454 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-bd416f76-045e-4464-be6e-1af04b762842 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:17.038176 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-bd416f76-045e-4464-be6e-1af04b762842 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1471 microversion: 2.1 time: 0.289455 Jun 01 04:30:17.038715 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 175/359] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:16 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1471 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:17.363392 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-f606cb29-752f-4434-9494-784b212a12b8 req-af3418c4-bf4b-4aa0-bd0d-e5e1b946b785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f96372c5-5ef6-48d0-b54e-5baa275732bf", "name": "network-vif-deleted", "tag": "e77f53f2-afd9-4725-9f83-6d76a6786cce"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:30:17.373121 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-f606cb29-752f-4434-9494-784b212a12b8 req-af3418c4-bf4b-4aa0-bd0d-e5e1b946b785 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:17.373645 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-f606cb29-752f-4434-9494-784b212a12b8 req-af3418c4-bf4b-4aa0-bd0d-e5e1b946b785 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:17.386570 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-f606cb29-752f-4434-9494-784b212a12b8 req-af3418c4-bf4b-4aa0-bd0d-e5e1b946b785 service nova] Creating event network-vif-deleted:e77f53f2-afd9-4725-9f83-6d76a6786cce for instance f96372c5-5ef6-48d0-b54e-5baa275732bf on hv-cinder-66710 Jun 01 04:30:17.392077 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-f606cb29-752f-4434-9494-784b212a12b8 req-af3418c4-bf4b-4aa0-bd0d-e5e1b946b785 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032161 Jun 01 04:30:17.392745 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 185/360] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:30:17.719951 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-942f76f6-d33e-4cb4-b553-af021621652f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Action: 'create', calling method: .version_select at 0x7ff32596b0d0>, body: {"keypair": {"name": "tempest-keypair-1101798254", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJY8j66YU/u6aIJtdfo1qMSe8baoewhXL8U3GqECWRkHpioY2OV7KbuBVddoH3hEfF2K2JJAx1o0QmtktPufXvvgpaSGUfRYfjqwxjhEwEh1DWYDgQKWqqli8MHZWYXu2w=="}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:30:17.734734 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-942f76f6-d33e-4cb4-b553-af021621652f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Getting quotas for project bda53dca70e54e208b2767a833923234. Resources: {'key_pairs'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:30:17.738645 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-942f76f6-d33e-4cb4-b553-af021621652f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Getting quotas for user 12816eca659542af9e41b92fdb674eab and project bda53dca70e54e208b2767a833923234. Resources: {'key_pairs'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:30:17.887711 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-942f76f6-d33e-4cb4-b553-af021621652f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.171551 Jun 01 04:30:17.888389 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 176/361] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jun 1 04:30:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:30:18.057368 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-5ae0c615-d932-4a2e-9892-fbd148720317 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:18.058051 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-5ae0c615-d932-4a2e-9892-fbd148720317 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:18.064489 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5ae0c615-d932-4a2e-9892-fbd148720317 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:18.064931 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5ae0c615-d932-4a2e-9892-fbd148720317 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:18.065697 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5ae0c615-d932-4a2e-9892-fbd148720317 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:18.066121 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5ae0c615-d932-4a2e-9892-fbd148720317 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:18.096035 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5ae0c615-d932-4a2e-9892-fbd148720317 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:18.096474 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5ae0c615-d932-4a2e-9892-fbd148720317 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:18.096918 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.objects.instance [None req-5ae0c615-d932-4a2e-9892-fbd148720317 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lazy-loading 'fault' on Instance uuid f96372c5-5ef6-48d0-b54e-5baa275732bf {{(pid=118517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:30:18.141253 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-5ae0c615-d932-4a2e-9892-fbd148720317 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be19da315701413e810d6e1274b36f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2080f03ddd148889160f6f51aa71955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:18.150132 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-5ae0c615-d932-4a2e-9892-fbd148720317 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 200 len: 1305 microversion: 2.1 time: 0.097838 Jun 01 04:30:18.151029 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 186/362] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:18 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:19.169216 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-8f78ab1a-2650-481b-9789-448dc6b9a2b5 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:19.169831 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-8f78ab1a-2650-481b-9789-448dc6b9a2b5 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] [instance: f96372c5-5ef6-48d0-b54e-5baa275732bf] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:19.181479 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8f78ab1a-2650-481b-9789-448dc6b9a2b5 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:19.181936 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8f78ab1a-2650-481b-9789-448dc6b9a2b5 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:19.182727 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8f78ab1a-2650-481b-9789-448dc6b9a2b5 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:19.183172 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8f78ab1a-2650-481b-9789-448dc6b9a2b5 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:19.199520 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.wsgi [None req-8f78ab1a-2650-481b-9789-448dc6b9a2b5 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] HTTP exception thrown: Instance f96372c5-5ef6-48d0-b54e-5baa275732bf could not be found. Jun 01 04:30:19.201793 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-8f78ab1a-2650-481b-9789-448dc6b9a2b5 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Request method failure captured: Jun 01 04:30:19.201793 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: request: GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf HTTP/1.1 Jun 01 04:30:19.201793 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept: application/json Jun 01 04:30:19.201793 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept-Encoding: identity Jun 01 04:30:19.201793 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Connection: close Jun 01 04:30:19.201793 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Length: 0 Jun 01 04:30:19.201793 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Type: application/json Jun 01 04:30:19.201793 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Host: 10.222.0.18 Jun 01 04:30:19.201793 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Openstack-System-Scope: None Jun 01 04:30:19.201793 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: User-Agent: python-urllib3/1.26.9 Jun 01 04:30:19.201793 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Auth-Token: gAAAAABilusnfqN35gHjFDPtz8gqhdExSZ1dYhTcvXyeDHtpM-8lqCzvl3S5RnMST-fzRqs9mqGalBOOFGU7eWmzcn4bSSTrmW0w8iuBu-mPlXJolmghO4_J2MbPwvkB9X77PawqTxJb_iaSHEaH8WZHP_GkS64KTgs5vHRPN_IbifAa_5C-9kA Jun 01 04:30:19.201793 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Id: None Jun 01 04:30:19.201793 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Name: None Jun 01 04:30:19.201793 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Identity-Status: Confirmed Jun 01 04:30:19.201793 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Is-Admin-Project: True Jun 01 04:30:19.201793 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Id: default Jun 01 04:30:19.201793 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Name: Default Jun 01 04:30:19.201793 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Id: e2080f03ddd148889160f6f51aa71955 Jun 01 04:30:19.201793 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Name: tempest-VolumesNegativeTest-1764600467 Jun 01 04:30:19.201793 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Role: reader,member Jun 01 04:30:19.201793 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Roles: reader,member Jun 01 04:30:19.203278 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e2080f03ddd148889160f6f51aa71955"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e2080f03ddd148889160f6f51aa71955"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e2080f03ddd148889160f6f51aa71955"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e2080f03ddd148889160f6f51aa71955"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:30:19.203278 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant: tempest-VolumesNegativeTest-1764600467 Jun 01 04:30:19.203278 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Id: e2080f03ddd148889160f6f51aa71955 Jun 01 04:30:19.203278 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Name: tempest-VolumesNegativeTest-1764600467 Jun 01 04:30:19.203278 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User: tempest-VolumesNegativeTest-1764600467-project Jun 01 04:30:19.203278 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Id: default Jun 01 04:30:19.203278 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Name: Default Jun 01 04:30:19.203278 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Id: be19da315701413e810d6e1274b36f2b Jun 01 04:30:19.203278 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Name: tempest-VolumesNegativeTest-1764600467-project Jun 01 04:30:19.203278 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: method: > Jun 01 04:30:19.203278 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: exception: Instance f96372c5-5ef6-48d0-b54e-5baa275732bf could not be found. Jun 01 04:30:19.203278 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: action_args: {'id': 'f96372c5-5ef6-48d0-b54e-5baa275732bf'} Jun 01 04:30:19.213220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:30:19.213220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:30:19.213220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:30:19.213220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:30:19.213220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:30:19.213220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:30:19.213220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:30:19.213220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:30:19.213220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:30:19.213220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:30:19.213220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f96372c5-5ef6-48d0-b54e-5baa275732bf could not be found. Jun 01 04:30:19.213220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:30:19.213220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:30:19.213220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:30:19.213220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:30:19.213220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:30:19.213220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:30:19.213220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:30:19.213220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:30:19.213220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:30:19.215012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:30:19.215012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 01 04:30:19.215012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 01 04:30:19.215012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:30:19.215012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:30:19.215012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:30:19.215012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:30:19.215012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f96372c5-5ef6-48d0-b54e-5baa275732bf could not be found. Jun 01 04:30:19.215012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:30:19.215012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:30:19.215012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:30:19.215012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:30:19.215012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:30:19.215012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:30:19.215012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:30:19.215012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:30:19.215012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f96372c5-5ef6-48d0-b54e-5baa275732bf could not be found. Jun 01 04:30:19.215012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:30:19.216347 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-8f78ab1a-2650-481b-9789-448dc6b9a2b5 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] Returning 404 to user: Instance f96372c5-5ef6-48d0-b54e-5baa275732bf could not be found. {{(pid=118516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:30:19.216347 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-8f78ab1a-2650-481b-9789-448dc6b9a2b5 tempest-VolumesNegativeTest-1764600467 tempest-VolumesNegativeTest-1764600467-project] 10.222.0.18 "GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf" status: 404 len: 111 microversion: 2.1 time: 0.041228 Jun 01 04:30:19.216347 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 177/363] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:19 2022] GET /compute/v2.1/servers/f96372c5-5ef6-48d0-b54e-5baa275732bf => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:30:20.592445 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-f5c6decf-ff3d-4cb5-adf1-b92686838906 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-855489478", "imageRef": "14321baa-3ac5-4c53-8054-4945abce5b2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "df968078-6547-44fa-a4b9-d4e6c486e9a4"}], "security_groups": [{"name": "tempest-securitygroup--1318378961"}], "key_name": "tempest-keypair-1101798254", "user_data": "}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:30:20.718653 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.network.neutron [None req-f5c6decf-ff3d-4cb5-adf1-b92686838906 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] validate_networks() for [('df968078-6547-44fa-a4b9-d4e6c486e9a4', None, None, None, None, None)] {{(pid=118517) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 01 04:30:21.122150 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-f5c6decf-ff3d-4cb5-adf1-b92686838906 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Flavor limits 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 01 04:30:21.122749 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-f5c6decf-ff3d-4cb5-adf1-b92686838906 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Image limits 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 01 04:30:21.123352 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-f5c6decf-ff3d-4cb5-adf1-b92686838906 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Flavor pref 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 01 04:30:21.123733 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-f5c6decf-ff3d-4cb5-adf1-b92686838906 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Image pref 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 01 04:30:21.125215 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-f5c6decf-ff3d-4cb5-adf1-b92686838906 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 01 04:30:21.133107 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f5c6decf-ff3d-4cb5-adf1-b92686838906 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:21.134121 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f5c6decf-ff3d-4cb5-adf1-b92686838906 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:21.135135 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f5c6decf-ff3d-4cb5-adf1-b92686838906 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:21.135664 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f5c6decf-ff3d-4cb5-adf1-b92686838906 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:21.153926 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.quota [None req-f5c6decf-ff3d-4cb5-adf1-b92686838906 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Getting quotas for project bda53dca70e54e208b2767a833923234. Resources: {'ram', 'instances', 'cores'} {{(pid=118517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:30:21.158435 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.quota [None req-f5c6decf-ff3d-4cb5-adf1-b92686838906 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Getting quotas for user 12816eca659542af9e41b92fdb674eab and project bda53dca70e54e208b2767a833923234. Resources: {'ram', 'instances', 'cores'} {{(pid=118517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:30:21.174134 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-f5c6decf-ff3d-4cb5-adf1-b92686838906 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Going to run 1 instances... {{(pid=118517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 01 04:30:21.176645 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-f5c6decf-ff3d-4cb5-adf1-b92686838906 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14321baa-3ac5-4c53-8054-4945abce5b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 01 04:30:21.334421 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-f5c6decf-ff3d-4cb5-adf1-b92686838906 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.746014 Jun 01 04:30:21.335741 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 187/364] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 1 04:30:20 2022] POST /compute/v2.1/servers => generated 409 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 01 04:30:21.345510 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-ed2553ea-04bc-423c-991d-763b1e2547b0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:21.346820 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-ed2553ea-04bc-423c-991d-763b1e2547b0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:21.427519 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-ed2553ea-04bc-423c-991d-763b1e2547b0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:21.436687 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-ed2553ea-04bc-423c-991d-763b1e2547b0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1245 microversion: 2.1 time: 0.094963 Jun 01 04:30:21.443930 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 178/365] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:21 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1245 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:22.454465 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-dee5569f-5ebd-47fd-8ad2-6e27231b07e3 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:22.454909 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-dee5569f-5ebd-47fd-8ad2-6e27231b07e3 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:22.513504 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-dee5569f-5ebd-47fd-8ad2-6e27231b07e3 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:22.522924 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-dee5569f-5ebd-47fd-8ad2-6e27231b07e3 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1245 microversion: 2.1 time: 0.072743 Jun 01 04:30:22.523528 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 188/366] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:22 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1245 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:23.541392 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-48eec2f0-2ccd-476f-9958-985e971bbcf4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:23.542152 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-48eec2f0-2ccd-476f-9958-985e971bbcf4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:23.550371 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-48eec2f0-2ccd-476f-9958-985e971bbcf4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:23.551142 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-48eec2f0-2ccd-476f-9958-985e971bbcf4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:23.551711 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-48eec2f0-2ccd-476f-9958-985e971bbcf4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:23.552312 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-48eec2f0-2ccd-476f-9958-985e971bbcf4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:23.633878 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-48eec2f0-2ccd-476f-9958-985e971bbcf4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:23.641954 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-48eec2f0-2ccd-476f-9958-985e971bbcf4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1297 microversion: 2.1 time: 0.105906 Jun 01 04:30:23.642987 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 179/367] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:23 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1297 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:30:24.666022 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-c260d48a-2d8c-4a61-a8bd-9ffcbcab56f5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:24.666729 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-c260d48a-2d8c-4a61-a8bd-9ffcbcab56f5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:24.678840 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c260d48a-2d8c-4a61-a8bd-9ffcbcab56f5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:24.679559 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c260d48a-2d8c-4a61-a8bd-9ffcbcab56f5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:24.684775 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c260d48a-2d8c-4a61-a8bd-9ffcbcab56f5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:24.684775 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c260d48a-2d8c-4a61-a8bd-9ffcbcab56f5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:24.796431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-c260d48a-2d8c-4a61-a8bd-9ffcbcab56f5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:24.809027 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-c260d48a-2d8c-4a61-a8bd-9ffcbcab56f5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1315 microversion: 2.1 time: 0.147509 Jun 01 04:30:24.811345 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 189/368] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:24 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:25.826514 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d3111fa6-53d7-4bb7-9265-d16aec1a373f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:25.830646 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-d3111fa6-53d7-4bb7-9265-d16aec1a373f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:25.848764 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d3111fa6-53d7-4bb7-9265-d16aec1a373f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:25.849218 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d3111fa6-53d7-4bb7-9265-d16aec1a373f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:25.854105 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d3111fa6-53d7-4bb7-9265-d16aec1a373f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:25.854636 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d3111fa6-53d7-4bb7-9265-d16aec1a373f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:26.447135 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-d3111fa6-53d7-4bb7-9265-d16aec1a373f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:26.455875 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-d3111fa6-53d7-4bb7-9265-d16aec1a373f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1371 microversion: 2.1 time: 0.633159 Jun 01 04:30:26.466405 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 180/369] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:25 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1371 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:27.128589 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-a66608e8-0ff3-4c13-9cba-b14078c69cd5 req-80662a3e-2d43-4c4a-89b6-6fddb90c90d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f8eae96-794e-4cdb-a397-0f892e3fd9f0", "tag": "ca205306-46cb-4b2c-ad84-b2f690075069"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:30:27.137734 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-a66608e8-0ff3-4c13-9cba-b14078c69cd5 req-80662a3e-2d43-4c4a-89b6-6fddb90c90d1 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:27.138407 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-a66608e8-0ff3-4c13-9cba-b14078c69cd5 req-80662a3e-2d43-4c4a-89b6-6fddb90c90d1 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:27.154250 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-a66608e8-0ff3-4c13-9cba-b14078c69cd5 req-80662a3e-2d43-4c4a-89b6-6fddb90c90d1 service nova] Creating event network-changed:ca205306-46cb-4b2c-ad84-b2f690075069 for instance 9f8eae96-794e-4cdb-a397-0f892e3fd9f0 on hv-cinder-66710 Jun 01 04:30:27.159383 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-a66608e8-0ff3-4c13-9cba-b14078c69cd5 req-80662a3e-2d43-4c4a-89b6-6fddb90c90d1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034534 Jun 01 04:30:27.160473 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 190/370] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:30:27.474972 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-253924ed-3b72-4fb5-ad87-4d29b158106b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:27.476364 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-253924ed-3b72-4fb5-ad87-4d29b158106b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:27.490951 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-253924ed-3b72-4fb5-ad87-4d29b158106b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:27.493810 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-253924ed-3b72-4fb5-ad87-4d29b158106b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:27.494863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-253924ed-3b72-4fb5-ad87-4d29b158106b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:27.498887 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-253924ed-3b72-4fb5-ad87-4d29b158106b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:27.837226 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-253924ed-3b72-4fb5-ad87-4d29b158106b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:27.842065 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:30:27.848285 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-253924ed-3b72-4fb5-ad87-4d29b158106b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1371 microversion: 2.1 time: 0.377760 Jun 01 04:30:27.850330 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 181/371] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:27 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1371 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:28.866970 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-8a0bc2d7-628c-44ad-9e4e-5ac464bec69d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:28.868218 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-8a0bc2d7-628c-44ad-9e4e-5ac464bec69d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:28.875878 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8a0bc2d7-628c-44ad-9e4e-5ac464bec69d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:28.876526 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8a0bc2d7-628c-44ad-9e4e-5ac464bec69d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:28.877976 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8a0bc2d7-628c-44ad-9e4e-5ac464bec69d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:28.878589 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8a0bc2d7-628c-44ad-9e4e-5ac464bec69d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:29.178496 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-8a0bc2d7-628c-44ad-9e4e-5ac464bec69d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:29.189340 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-8a0bc2d7-628c-44ad-9e4e-5ac464bec69d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1371 microversion: 2.1 time: 0.326552 Jun 01 04:30:29.189921 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 191/372] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:28 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1371 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:30.206640 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-80aa61ff-fdb2-49f5-92f3-7bc12f1b098b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:30.207257 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-80aa61ff-fdb2-49f5-92f3-7bc12f1b098b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:30.215016 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-80aa61ff-fdb2-49f5-92f3-7bc12f1b098b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:30.215513 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-80aa61ff-fdb2-49f5-92f3-7bc12f1b098b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:30.216307 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-80aa61ff-fdb2-49f5-92f3-7bc12f1b098b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:30.216751 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-80aa61ff-fdb2-49f5-92f3-7bc12f1b098b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:30.396486 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-80aa61ff-fdb2-49f5-92f3-7bc12f1b098b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:30.408599 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-80aa61ff-fdb2-49f5-92f3-7bc12f1b098b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1371 microversion: 2.1 time: 0.206060 Jun 01 04:30:30.413753 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 182/373] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:30 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:31.426401 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-7c0951f9-15d3-40ee-86f0-7f80576d965f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:31.427001 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-7c0951f9-15d3-40ee-86f0-7f80576d965f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:31.436470 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell0:SELECT=2 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:30:31.440743 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7c0951f9-15d3-40ee-86f0-7f80576d965f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:31.441392 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7c0951f9-15d3-40ee-86f0-7f80576d965f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:31.442336 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7c0951f9-15d3-40ee-86f0-7f80576d965f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:31.442994 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7c0951f9-15d3-40ee-86f0-7f80576d965f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:31.608319 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-7c0951f9-15d3-40ee-86f0-7f80576d965f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:31.617104 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-7c0951f9-15d3-40ee-86f0-7f80576d965f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1371 microversion: 2.1 time: 0.194579 Jun 01 04:30:31.886823 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 192/374] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:31 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:32.655802 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-7c78f2aa-4933-4816-88bf-a4c577c09a3d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:32.656420 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-7c78f2aa-4933-4816-88bf-a4c577c09a3d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:32.660289 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell0:SELECT=6 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:30:32.666539 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7c78f2aa-4933-4816-88bf-a4c577c09a3d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:32.667239 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7c78f2aa-4933-4816-88bf-a4c577c09a3d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:32.668224 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7c78f2aa-4933-4816-88bf-a4c577c09a3d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:32.668661 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7c78f2aa-4933-4816-88bf-a4c577c09a3d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:32.881657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-7c78f2aa-4933-4816-88bf-a4c577c09a3d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:32.895918 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-7c78f2aa-4933-4816-88bf-a4c577c09a3d tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1371 microversion: 2.1 time: 0.244066 Jun 01 04:30:32.897152 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 183/375] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:32 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:33.918770 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell0:SELECT=8 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:30:33.927924 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-d972bc01-916a-4ff9-8a83-50623abae433 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:33.928914 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-d972bc01-916a-4ff9-8a83-50623abae433 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:33.934983 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:30:33.936899 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d972bc01-916a-4ff9-8a83-50623abae433 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:33.937348 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d972bc01-916a-4ff9-8a83-50623abae433 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:33.939021 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d972bc01-916a-4ff9-8a83-50623abae433 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:33.939021 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d972bc01-916a-4ff9-8a83-50623abae433 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:34.164711 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-d972bc01-916a-4ff9-8a83-50623abae433 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:34.174789 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-d972bc01-916a-4ff9-8a83-50623abae433 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1371 microversion: 2.1 time: 0.263632 Jun 01 04:30:34.175913 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 193/376] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:33 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1371 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:35.197587 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-62f0d064-9bcf-47c7-9829-ab79a98be165 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:35.198341 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-62f0d064-9bcf-47c7-9829-ab79a98be165 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:35.207757 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:30:35.232905 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-62f0d064-9bcf-47c7-9829-ab79a98be165 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:35.233317 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-62f0d064-9bcf-47c7-9829-ab79a98be165 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:35.234162 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-62f0d064-9bcf-47c7-9829-ab79a98be165 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:35.234609 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-62f0d064-9bcf-47c7-9829-ab79a98be165 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:35.660313 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-62f0d064-9bcf-47c7-9829-ab79a98be165 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:35.671659 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-62f0d064-9bcf-47c7-9829-ab79a98be165 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1371 microversion: 2.1 time: 0.483114 Jun 01 04:30:35.672400 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 184/377] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:35 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1371 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:36.690053 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-0ddcac99-38c2-454c-9a2d-bdb1dbb688c7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:36.691439 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-0ddcac99-38c2-454c-9a2d-bdb1dbb688c7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:36.703463 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0ddcac99-38c2-454c-9a2d-bdb1dbb688c7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:36.703916 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0ddcac99-38c2-454c-9a2d-bdb1dbb688c7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:36.704701 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0ddcac99-38c2-454c-9a2d-bdb1dbb688c7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:36.705141 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0ddcac99-38c2-454c-9a2d-bdb1dbb688c7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:36.984225 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-0ddcac99-38c2-454c-9a2d-bdb1dbb688c7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:36.997782 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-0ddcac99-38c2-454c-9a2d-bdb1dbb688c7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1371 microversion: 2.1 time: 0.312549 Jun 01 04:30:37.001070 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 194/378] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:36 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1371 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:38.020979 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-4b7c0ca7-9bc5-4015-a6ff-ed4cee999516 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:38.022185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-4b7c0ca7-9bc5-4015-a6ff-ed4cee999516 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:38.037478 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4b7c0ca7-9bc5-4015-a6ff-ed4cee999516 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:38.044311 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4b7c0ca7-9bc5-4015-a6ff-ed4cee999516 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:38.044311 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4b7c0ca7-9bc5-4015-a6ff-ed4cee999516 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:38.044311 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4b7c0ca7-9bc5-4015-a6ff-ed4cee999516 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:38.381359 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-4b7c0ca7-9bc5-4015-a6ff-ed4cee999516 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:38.390027 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-4b7c0ca7-9bc5-4015-a6ff-ed4cee999516 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1371 microversion: 2.1 time: 0.374696 Jun 01 04:30:38.390854 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 185/379] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:38 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1371 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:39.369005 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-0ac8dccd-79c5-4986-89fd-f44b7a7c9604 req-0aa8dc23-913c-4c69-8ced-1a7da6aab087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f8eae96-794e-4cdb-a397-0f892e3fd9f0", "name": "network-vif-plugged", "status": "completed", "tag": "ca205306-46cb-4b2c-ad84-b2f690075069"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:30:39.388378 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-0ac8dccd-79c5-4986-89fd-f44b7a7c9604 req-0aa8dc23-913c-4c69-8ced-1a7da6aab087 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:39.388969 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-0ac8dccd-79c5-4986-89fd-f44b7a7c9604 req-0aa8dc23-913c-4c69-8ced-1a7da6aab087 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:39.415043 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-dff4fbd7-4448-4121-a17a-36be39d06db9 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:39.416345 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-dff4fbd7-4448-4121-a17a-36be39d06db9 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:39.426468 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-dff4fbd7-4448-4121-a17a-36be39d06db9 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:39.427607 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-dff4fbd7-4448-4121-a17a-36be39d06db9 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:39.428675 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-dff4fbd7-4448-4121-a17a-36be39d06db9 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:39.429355 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-dff4fbd7-4448-4121-a17a-36be39d06db9 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:39.432070 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-0ac8dccd-79c5-4986-89fd-f44b7a7c9604 req-0aa8dc23-913c-4c69-8ced-1a7da6aab087 service nova] Creating event network-vif-plugged:ca205306-46cb-4b2c-ad84-b2f690075069 for instance 9f8eae96-794e-4cdb-a397-0f892e3fd9f0 on hv-cinder-66710 Jun 01 04:30:39.456019 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-0ac8dccd-79c5-4986-89fd-f44b7a7c9604 req-0aa8dc23-913c-4c69-8ced-1a7da6aab087 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091240 Jun 01 04:30:39.465990 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 195/380] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:30:39.984357 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-dff4fbd7-4448-4121-a17a-36be39d06db9 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:40.014733 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-dff4fbd7-4448-4121-a17a-36be39d06db9 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1371 microversion: 2.1 time: 0.608563 Jun 01 04:30:40.015636 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 186/381] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:39 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1371 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:41.005502 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-57f7066f-a082-4ea7-8fd0-ec73b648ffdd tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Action: 'create', calling method: .version_select at 0x7ff3262a44c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1514032961", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAg3ZKlFnKMkOhjLu0M+u/5//IW4zR9YAWqcyo1rnwTD5OKZlOiFAj9SFfQ0XMm0VGWHAhxD8X3dL2mAz2gFf7nm7MvNJArK6qJ96/F0VBD/hbQ3uT6DhPYjPgLo8/UsZQ=="}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:30:41.025618 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.quota [None req-57f7066f-a082-4ea7-8fd0-ec73b648ffdd tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Getting quotas for project 9369d530285849b3a9eac5e0034d3170. Resources: {'key_pairs'} {{(pid=118517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:30:41.030568 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.quota [None req-57f7066f-a082-4ea7-8fd0-ec73b648ffdd tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Getting quotas for user c052b2f518064843928b4eff569e913f and project 9369d530285849b3a9eac5e0034d3170. Resources: {'key_pairs'} {{(pid=118517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:30:41.031994 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-9c147427-9b1c-492e-b98a-1231c4dec000 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:41.033287 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-9c147427-9b1c-492e-b98a-1231c4dec000 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:41.042589 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9c147427-9b1c-492e-b98a-1231c4dec000 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:41.043269 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9c147427-9b1c-492e-b98a-1231c4dec000 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:41.044087 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9c147427-9b1c-492e-b98a-1231c4dec000 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:41.044539 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9c147427-9b1c-492e-b98a-1231c4dec000 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:41.156286 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-57f7066f-a082-4ea7-8fd0-ec73b648ffdd tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.395134 Jun 01 04:30:41.167490 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 196/382] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jun 1 04:30:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:30:41.203114 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-9c147427-9b1c-492e-b98a-1231c4dec000 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:41.214263 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-9c147427-9b1c-492e-b98a-1231c4dec000 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1371 microversion: 2.1 time: 0.185985 Jun 01 04:30:41.232697 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 187/383] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:41 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1371 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:42.254027 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-068700c5-4cdc-4ec6-bc70-555e067df791 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:42.254765 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-068700c5-4cdc-4ec6-bc70-555e067df791 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:42.268511 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-068700c5-4cdc-4ec6-bc70-555e067df791 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:42.268961 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-068700c5-4cdc-4ec6-bc70-555e067df791 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:42.269935 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-068700c5-4cdc-4ec6-bc70-555e067df791 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:42.270547 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-068700c5-4cdc-4ec6-bc70-555e067df791 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:42.467071 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-068700c5-4cdc-4ec6-bc70-555e067df791 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:30:42.476123 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-068700c5-4cdc-4ec6-bc70-555e067df791 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1564 microversion: 2.1 time: 0.227841 Jun 01 04:30:42.476850 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 197/384] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:30:42 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1564 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:30:42.496978 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-e59733e1-374d-44f8-8a9e-878056a9d4dd tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:30:42.497757 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-e59733e1-374d-44f8-8a9e-878056a9d4dd tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:30:42.504240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e59733e1-374d-44f8-8a9e-878056a9d4dd tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:42.504895 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e59733e1-374d-44f8-8a9e-878056a9d4dd tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:42.506369 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e59733e1-374d-44f8-8a9e-878056a9d4dd tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:42.506922 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e59733e1-374d-44f8-8a9e-878056a9d4dd tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:42.702569 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-e59733e1-374d-44f8-8a9e-878056a9d4dd tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.209434 Jun 01 04:30:42.703363 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 188/385] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Jun 1 04:30:42 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0/os-interface => generated 284 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:30:44.729514 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-a790430e-11d4-48dc-be0e-7230621b42e1 req-64812763-4ccf-426f-9fa0-6e2f5cf66efa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f8eae96-794e-4cdb-a397-0f892e3fd9f0", "tag": "ca205306-46cb-4b2c-ad84-b2f690075069"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:30:44.740112 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-a790430e-11d4-48dc-be0e-7230621b42e1 req-64812763-4ccf-426f-9fa0-6e2f5cf66efa service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:30:44.741007 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-a790430e-11d4-48dc-be0e-7230621b42e1 req-64812763-4ccf-426f-9fa0-6e2f5cf66efa service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:30:44.754777 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=61 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:30:44.763167 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-a790430e-11d4-48dc-be0e-7230621b42e1 req-64812763-4ccf-426f-9fa0-6e2f5cf66efa service nova] Creating event network-changed:ca205306-46cb-4b2c-ad84-b2f690075069 for instance 9f8eae96-794e-4cdb-a397-0f892e3fd9f0 on hv-cinder-66710 Jun 01 04:30:44.770401 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-a790430e-11d4-48dc-be0e-7230621b42e1 req-64812763-4ccf-426f-9fa0-6e2f5cf66efa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050918 Jun 01 04:30:44.771354 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 198/386] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:31:08.094372 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_api:SELECT=9 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:31:08.095196 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=40 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:31:08.099122 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-74d6dfcd-e7be-4e0b-bfe2-b4aeff7e24d2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:08.099866 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-74d6dfcd-e7be-4e0b-bfe2-b4aeff7e24d2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:08.106587 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-74d6dfcd-e7be-4e0b-bfe2-b4aeff7e24d2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:08.107034 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-74d6dfcd-e7be-4e0b-bfe2-b4aeff7e24d2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:08.107822 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-74d6dfcd-e7be-4e0b-bfe2-b4aeff7e24d2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:08.108257 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-74d6dfcd-e7be-4e0b-bfe2-b4aeff7e24d2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:08.132979 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-74d6dfcd-e7be-4e0b-bfe2-b4aeff7e24d2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16/ips" status: 200 len: 152 microversion: 2.20 time: 0.039970 Jun 01 04:31:08.133916 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 189/387] 10.222.0.18 () {60 vars in 1288 bytes} [Wed Jun 1 04:31:08 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 01 04:31:11.653052 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell0:SELECT=4 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:31:11.653886 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=1 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:31:11.658954 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-576d9fb1-33b3-4b5f-a651-21a605b765a0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:31:11.664449 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-576d9fb1-33b3-4b5f-a651-21a605b765a0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:11.665570 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-576d9fb1-33b3-4b5f-a651-21a605b765a0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:11.666035 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-576d9fb1-33b3-4b5f-a651-21a605b765a0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:11.666774 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-576d9fb1-33b3-4b5f-a651-21a605b765a0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:11.667208 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-576d9fb1-33b3-4b5f-a651-21a605b765a0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:11.690004 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.objects.instance [None req-576d9fb1-33b3-4b5f-a651-21a605b765a0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lazy-loading 'flavor' on Instance uuid c961e06b-1b03-4e97-8487-57adba5d5e16 {{(pid=118517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:31:12.230909 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-576d9fb1-33b3-4b5f-a651-21a605b765a0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "POST /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16/action" status: 202 len: 0 microversion: 2.20 time: 0.577984 Jun 01 04:31:12.231791 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 199/388] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Jun 1 04:31:11 2022] POST /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16/action => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 01 04:31:12.245126 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-800bd929-b9ac-4bce-9637-a1767d17731a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:12.249778 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-800bd929-b9ac-4bce-9637-a1767d17731a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:12.259913 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-800bd929-b9ac-4bce-9637-a1767d17731a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:12.260370 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-800bd929-b9ac-4bce-9637-a1767d17731a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:12.261177 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-800bd929-b9ac-4bce-9637-a1767d17731a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:12.261588 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-800bd929-b9ac-4bce-9637-a1767d17731a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:12.405761 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-800bd929-b9ac-4bce-9637-a1767d17731a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:12.414095 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-800bd929-b9ac-4bce-9637-a1767d17731a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:12.415676 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-800bd929-b9ac-4bce-9637-a1767d17731a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:12.416843 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-800bd929-b9ac-4bce-9637-a1767d17731a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1725 microversion: 2.20 time: 0.181091 Jun 01 04:31:12.417403 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 190/389] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:12 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:31:13.437559 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-7526e5f2-af83-4232-8315-60b2796019e9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:13.438141 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-7526e5f2-af83-4232-8315-60b2796019e9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:13.444577 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7526e5f2-af83-4232-8315-60b2796019e9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:13.445028 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7526e5f2-af83-4232-8315-60b2796019e9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:13.445795 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7526e5f2-af83-4232-8315-60b2796019e9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:13.446227 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7526e5f2-af83-4232-8315-60b2796019e9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:13.577904 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-7526e5f2-af83-4232-8315-60b2796019e9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:13.585972 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-7526e5f2-af83-4232-8315-60b2796019e9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:13.587506 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-7526e5f2-af83-4232-8315-60b2796019e9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:13.588645 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-7526e5f2-af83-4232-8315-60b2796019e9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1725 microversion: 2.20 time: 0.156118 Jun 01 04:31:13.589193 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 200/390] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:13 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:31:14.606942 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-127ed184-6dee-46d3-8720-df3a7a45b1ba tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:14.607516 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-127ed184-6dee-46d3-8720-df3a7a45b1ba tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:14.614949 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-127ed184-6dee-46d3-8720-df3a7a45b1ba tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:14.615418 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-127ed184-6dee-46d3-8720-df3a7a45b1ba tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:14.616181 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-127ed184-6dee-46d3-8720-df3a7a45b1ba tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:14.616614 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-127ed184-6dee-46d3-8720-df3a7a45b1ba tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:14.751175 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-127ed184-6dee-46d3-8720-df3a7a45b1ba tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:14.759548 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-127ed184-6dee-46d3-8720-df3a7a45b1ba tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:14.761081 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-127ed184-6dee-46d3-8720-df3a7a45b1ba tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:14.762705 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-127ed184-6dee-46d3-8720-df3a7a45b1ba tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1725 microversion: 2.20 time: 0.159299 Jun 01 04:31:14.762997 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 191/391] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:14 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:31:15.780499 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-e6884117-6ef3-4d3b-a0d1-ba68f8adad7c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:15.781101 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-e6884117-6ef3-4d3b-a0d1-ba68f8adad7c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:15.787024 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e6884117-6ef3-4d3b-a0d1-ba68f8adad7c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:15.787552 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e6884117-6ef3-4d3b-a0d1-ba68f8adad7c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:15.788309 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e6884117-6ef3-4d3b-a0d1-ba68f8adad7c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:15.788743 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e6884117-6ef3-4d3b-a0d1-ba68f8adad7c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:15.918808 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-e6884117-6ef3-4d3b-a0d1-ba68f8adad7c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:15.927245 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-e6884117-6ef3-4d3b-a0d1-ba68f8adad7c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:15.928777 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-e6884117-6ef3-4d3b-a0d1-ba68f8adad7c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:15.929930 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-e6884117-6ef3-4d3b-a0d1-ba68f8adad7c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1725 microversion: 2.20 time: 0.153293 Jun 01 04:31:15.930488 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 201/392] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:15 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:31:16.948507 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-c3bfca8e-2b10-4c8b-85e9-0fffc26bec53 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:16.949109 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-c3bfca8e-2b10-4c8b-85e9-0fffc26bec53 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:16.956571 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c3bfca8e-2b10-4c8b-85e9-0fffc26bec53 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:16.957017 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c3bfca8e-2b10-4c8b-85e9-0fffc26bec53 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:16.957767 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c3bfca8e-2b10-4c8b-85e9-0fffc26bec53 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:16.958199 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c3bfca8e-2b10-4c8b-85e9-0fffc26bec53 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:17.091526 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-c3bfca8e-2b10-4c8b-85e9-0fffc26bec53 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:17.099940 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-c3bfca8e-2b10-4c8b-85e9-0fffc26bec53 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:17.101442 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-c3bfca8e-2b10-4c8b-85e9-0fffc26bec53 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:17.102584 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-c3bfca8e-2b10-4c8b-85e9-0fffc26bec53 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1725 microversion: 2.20 time: 0.157925 Jun 01 04:31:17.103135 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 192/393] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:16 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:31:18.121344 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-87def28c-2efd-4ba4-b394-cd121013b201 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:18.121861 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-87def28c-2efd-4ba4-b394-cd121013b201 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:18.127759 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-87def28c-2efd-4ba4-b394-cd121013b201 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:18.128199 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-87def28c-2efd-4ba4-b394-cd121013b201 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:18.128946 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-87def28c-2efd-4ba4-b394-cd121013b201 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:18.129373 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-87def28c-2efd-4ba4-b394-cd121013b201 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:18.254710 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-87def28c-2efd-4ba4-b394-cd121013b201 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:18.262637 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-87def28c-2efd-4ba4-b394-cd121013b201 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:18.264681 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-87def28c-2efd-4ba4-b394-cd121013b201 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:18.265808 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-87def28c-2efd-4ba4-b394-cd121013b201 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1725 microversion: 2.20 time: 0.148457 Jun 01 04:31:18.266351 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 202/394] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:18 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:31:19.285330 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-40169d11-644d-4230-af75-40471cd656b0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:19.286140 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-40169d11-644d-4230-af75-40471cd656b0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:19.292833 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-40169d11-644d-4230-af75-40471cd656b0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:19.293300 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-40169d11-644d-4230-af75-40471cd656b0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:19.294080 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-40169d11-644d-4230-af75-40471cd656b0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:19.294511 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-40169d11-644d-4230-af75-40471cd656b0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:19.434309 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-40169d11-644d-4230-af75-40471cd656b0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:19.443681 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-40169d11-644d-4230-af75-40471cd656b0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:19.445210 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-40169d11-644d-4230-af75-40471cd656b0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:19.446423 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-40169d11-644d-4230-af75-40471cd656b0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1725 microversion: 2.20 time: 0.165866 Jun 01 04:31:19.447008 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 193/395] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:19 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:31:20.465754 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-bde24b9a-9b5d-4506-90bb-c31f76198dc7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:20.466312 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-bde24b9a-9b5d-4506-90bb-c31f76198dc7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:20.472948 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bde24b9a-9b5d-4506-90bb-c31f76198dc7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:20.473400 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bde24b9a-9b5d-4506-90bb-c31f76198dc7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:20.474170 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bde24b9a-9b5d-4506-90bb-c31f76198dc7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:20.474610 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bde24b9a-9b5d-4506-90bb-c31f76198dc7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:20.604323 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-bde24b9a-9b5d-4506-90bb-c31f76198dc7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:20.612393 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-bde24b9a-9b5d-4506-90bb-c31f76198dc7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:20.614165 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-bde24b9a-9b5d-4506-90bb-c31f76198dc7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:20.615380 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-bde24b9a-9b5d-4506-90bb-c31f76198dc7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1725 microversion: 2.20 time: 0.153562 Jun 01 04:31:20.620054 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 203/396] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:20 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:31:21.634079 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-6c3108a2-d8ba-4ae5-a188-497f7b72f36e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:21.634693 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-6c3108a2-d8ba-4ae5-a188-497f7b72f36e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:21.641203 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6c3108a2-d8ba-4ae5-a188-497f7b72f36e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:21.641661 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6c3108a2-d8ba-4ae5-a188-497f7b72f36e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:21.642426 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6c3108a2-d8ba-4ae5-a188-497f7b72f36e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:21.642867 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6c3108a2-d8ba-4ae5-a188-497f7b72f36e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:21.782065 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-6c3108a2-d8ba-4ae5-a188-497f7b72f36e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:21.791715 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-6c3108a2-d8ba-4ae5-a188-497f7b72f36e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:21.793433 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-6c3108a2-d8ba-4ae5-a188-497f7b72f36e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:21.794682 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-6c3108a2-d8ba-4ae5-a188-497f7b72f36e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1725 microversion: 2.20 time: 0.164462 Jun 01 04:31:21.795278 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 194/397] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:21 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:31:21.899260 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a56c77eb-408e-4a41-8867-2ed6660d4a93 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1721459883", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1514032961", "security_groups": [{"name": "tempest-secgroup-smoke-799074218"}], "block_device_mapping_v2": [{"uuid": "7b8e0ca5-93c7-47dc-aa39-3cd3175028c7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e3dc963a-6f83-4418-ad4a-91353c23b06d"}]}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:31:22.013569 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.network.neutron [None req-a56c77eb-408e-4a41-8867-2ed6660d4a93 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] validate_networks() for [('e3dc963a-6f83-4418-ad4a-91353c23b06d', None, None, None, None, None)] {{(pid=118517) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 01 04:31:22.377731 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-a56c77eb-408e-4a41-8867-2ed6660d4a93 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Flavor limits 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 01 04:31:22.378148 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-a56c77eb-408e-4a41-8867-2ed6660d4a93 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Image limits 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 01 04:31:22.378617 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-a56c77eb-408e-4a41-8867-2ed6660d4a93 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Flavor pref 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 01 04:31:22.379054 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-a56c77eb-408e-4a41-8867-2ed6660d4a93 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Image pref 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 01 04:31:22.379508 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-a56c77eb-408e-4a41-8867-2ed6660d4a93 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 01 04:31:22.388644 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a56c77eb-408e-4a41-8867-2ed6660d4a93 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:22.393491 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a56c77eb-408e-4a41-8867-2ed6660d4a93 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:22.393491 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a56c77eb-408e-4a41-8867-2ed6660d4a93 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:22.393491 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a56c77eb-408e-4a41-8867-2ed6660d4a93 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:22.408084 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.quota [None req-a56c77eb-408e-4a41-8867-2ed6660d4a93 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Getting quotas for project 9369d530285849b3a9eac5e0034d3170. Resources: {'ram', 'instances', 'cores'} {{(pid=118517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:31:22.412079 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.quota [None req-a56c77eb-408e-4a41-8867-2ed6660d4a93 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Getting quotas for user c052b2f518064843928b4eff569e913f and project 9369d530285849b3a9eac5e0034d3170. Resources: {'ram', 'instances', 'cores'} {{(pid=118517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:31:22.468393 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-a56c77eb-408e-4a41-8867-2ed6660d4a93 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Going to run 1 instances... {{(pid=118517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 01 04:31:22.470501 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-a56c77eb-408e-4a41-8867-2ed6660d4a93 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7b8e0ca5-93c7-47dc-aa39-3cd3175028c7',volume_size=None,volume_type=None)] {{(pid=118517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 01 04:31:22.813538 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-c0a0220f-d299-49ea-af10-5ac46835f6fb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:22.814219 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-c0a0220f-d299-49ea-af10-5ac46835f6fb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:22.820990 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c0a0220f-d299-49ea-af10-5ac46835f6fb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:22.821431 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c0a0220f-d299-49ea-af10-5ac46835f6fb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:22.822306 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c0a0220f-d299-49ea-af10-5ac46835f6fb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:22.822742 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c0a0220f-d299-49ea-af10-5ac46835f6fb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:22.875198 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-a56c77eb-408e-4a41-8867-2ed6660d4a93 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.980202 Jun 01 04:31:22.881034 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 204/398] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 1 04:31:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 01 04:31:22.886071 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-29c1fa50-3897-470c-a854-4f54624bc531 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:22.886974 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-29c1fa50-3897-470c-a854-4f54624bc531 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:22.950572 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-29c1fa50-3897-470c-a854-4f54624bc531 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:22.957916 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-29c1fa50-3897-470c-a854-4f54624bc531 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e" status: 200 len: 1095 microversion: 2.1 time: 0.075680 Jun 01 04:31:22.961397 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-c0a0220f-d299-49ea-af10-5ac46835f6fb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:22.967576 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 205/399] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:22 2022] GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e => generated 1095 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:31:22.970748 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-c0a0220f-d299-49ea-af10-5ac46835f6fb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:22.972270 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-c0a0220f-d299-49ea-af10-5ac46835f6fb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:22.973588 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-c0a0220f-d299-49ea-af10-5ac46835f6fb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1725 microversion: 2.20 time: 0.163910 Jun 01 04:31:22.974144 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 195/400] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:22 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:31:23.975395 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-d587f6fe-9eec-4a1f-8940-7836a6e57920 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:23.976032 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-d587f6fe-9eec-4a1f-8940-7836a6e57920 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:23.982698 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d587f6fe-9eec-4a1f-8940-7836a6e57920 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:23.983176 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d587f6fe-9eec-4a1f-8940-7836a6e57920 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:23.983990 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d587f6fe-9eec-4a1f-8940-7836a6e57920 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:23.984431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d587f6fe-9eec-4a1f-8940-7836a6e57920 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:23.991841 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b79f1f56-6276-4db3-8c23-7df254d099cb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:23.992536 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-b79f1f56-6276-4db3-8c23-7df254d099cb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:23.998985 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b79f1f56-6276-4db3-8c23-7df254d099cb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:23.999575 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b79f1f56-6276-4db3-8c23-7df254d099cb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:24.000407 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b79f1f56-6276-4db3-8c23-7df254d099cb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:24.000914 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b79f1f56-6276-4db3-8c23-7df254d099cb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:24.045195 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-d587f6fe-9eec-4a1f-8940-7836a6e57920 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:24.053142 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-d587f6fe-9eec-4a1f-8940-7836a6e57920 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e" status: 200 len: 1145 microversion: 2.1 time: 0.081519 Jun 01 04:31:24.053838 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 206/401] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:23 2022] GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:31:24.136206 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b79f1f56-6276-4db3-8c23-7df254d099cb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:24.144767 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b79f1f56-6276-4db3-8c23-7df254d099cb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:24.146312 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b79f1f56-6276-4db3-8c23-7df254d099cb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:24.147501 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-b79f1f56-6276-4db3-8c23-7df254d099cb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1725 microversion: 2.20 time: 0.159971 Jun 01 04:31:24.148886 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 196/402] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:23 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:31:25.070165 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-9107760d-c092-4323-836b-e62abb701b1d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:25.070788 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-9107760d-c092-4323-836b-e62abb701b1d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:25.077417 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9107760d-c092-4323-836b-e62abb701b1d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:25.077863 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9107760d-c092-4323-836b-e62abb701b1d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:25.079086 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9107760d-c092-4323-836b-e62abb701b1d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:25.079563 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9107760d-c092-4323-836b-e62abb701b1d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:25.146152 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-9107760d-c092-4323-836b-e62abb701b1d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:25.153924 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-9107760d-c092-4323-836b-e62abb701b1d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e" status: 200 len: 1201 microversion: 2.1 time: 0.087538 Jun 01 04:31:25.154770 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 207/403] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:25 2022] GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e => generated 1201 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:31:25.166154 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-85bd67c9-8a89-46a9-8ee1-c1c5a02725a2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:25.166905 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-85bd67c9-8a89-46a9-8ee1-c1c5a02725a2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:25.175712 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-85bd67c9-8a89-46a9-8ee1-c1c5a02725a2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:25.175712 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-85bd67c9-8a89-46a9-8ee1-c1c5a02725a2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:25.175712 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-85bd67c9-8a89-46a9-8ee1-c1c5a02725a2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:25.175991 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-85bd67c9-8a89-46a9-8ee1-c1c5a02725a2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:25.353513 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-85bd67c9-8a89-46a9-8ee1-c1c5a02725a2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:25.362392 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-85bd67c9-8a89-46a9-8ee1-c1c5a02725a2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:25.365122 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-85bd67c9-8a89-46a9-8ee1-c1c5a02725a2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:25.370521 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-85bd67c9-8a89-46a9-8ee1-c1c5a02725a2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1725 microversion: 2.20 time: 0.208150 Jun 01 04:31:25.372686 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 197/404] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:25 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1725 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:31:26.171263 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-79d672d1-ce5d-4e1a-a71a-339b3e31a507 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:26.172198 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-79d672d1-ce5d-4e1a-a71a-339b3e31a507 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:26.178412 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-79d672d1-ce5d-4e1a-a71a-339b3e31a507 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:26.178858 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-79d672d1-ce5d-4e1a-a71a-339b3e31a507 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:26.179717 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-79d672d1-ce5d-4e1a-a71a-339b3e31a507 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:26.180151 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-79d672d1-ce5d-4e1a-a71a-339b3e31a507 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:26.332816 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-79d672d1-ce5d-4e1a-a71a-339b3e31a507 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:26.340408 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-79d672d1-ce5d-4e1a-a71a-339b3e31a507 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e" status: 200 len: 1278 microversion: 2.1 time: 0.173179 Jun 01 04:31:26.341029 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 208/405] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:26 2022] GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e => generated 1278 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:31:26.390820 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-1236a7d9-c5e4-437d-afd5-e93f4e423af8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:26.392009 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-1236a7d9-c5e4-437d-afd5-e93f4e423af8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:26.398907 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1236a7d9-c5e4-437d-afd5-e93f4e423af8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:26.399488 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1236a7d9-c5e4-437d-afd5-e93f4e423af8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:26.400360 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1236a7d9-c5e4-437d-afd5-e93f4e423af8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:26.400946 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1236a7d9-c5e4-437d-afd5-e93f4e423af8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:26.612373 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-1236a7d9-c5e4-437d-afd5-e93f4e423af8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:26.622239 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-1236a7d9-c5e4-437d-afd5-e93f4e423af8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:26.624118 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-1236a7d9-c5e4-437d-afd5-e93f4e423af8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:26.625985 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-1236a7d9-c5e4-437d-afd5-e93f4e423af8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1725 microversion: 2.20 time: 0.239234 Jun 01 04:31:26.626777 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 198/406] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:26 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1725 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:31:27.128815 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-613ebf11-d9d7-4057-a31f-038776bac228 req-e495c4e3-a234-428f-bd4f-c52c8a14cc94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a724f928-21b8-4379-a078-600dc46ce06e", "tag": "52757b70-1a8f-4bea-8511-23d4b4a70ddf"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:31:27.143259 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-613ebf11-d9d7-4057-a31f-038776bac228 req-e495c4e3-a234-428f-bd4f-c52c8a14cc94 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:27.143747 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-613ebf11-d9d7-4057-a31f-038776bac228 req-e495c4e3-a234-428f-bd4f-c52c8a14cc94 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:27.158492 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-613ebf11-d9d7-4057-a31f-038776bac228 req-e495c4e3-a234-428f-bd4f-c52c8a14cc94 service nova] Creating event network-changed:52757b70-1a8f-4bea-8511-23d4b4a70ddf for instance a724f928-21b8-4379-a078-600dc46ce06e on hv-cinder-66710 Jun 01 04:31:27.165859 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-613ebf11-d9d7-4057-a31f-038776bac228 req-e495c4e3-a234-428f-bd4f-c52c8a14cc94 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041156 Jun 01 04:31:27.166647 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 209/407] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:31:27.358054 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-26322af2-d554-4345-ad56-899a524579f4 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:27.358677 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-26322af2-d554-4345-ad56-899a524579f4 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:27.368882 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-26322af2-d554-4345-ad56-899a524579f4 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:27.369345 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-26322af2-d554-4345-ad56-899a524579f4 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:27.370139 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-26322af2-d554-4345-ad56-899a524579f4 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:27.370592 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-26322af2-d554-4345-ad56-899a524579f4 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:27.571376 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-26322af2-d554-4345-ad56-899a524579f4 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:27.579412 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-26322af2-d554-4345-ad56-899a524579f4 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e" status: 200 len: 1266 microversion: 2.1 time: 0.225083 Jun 01 04:31:27.588955 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 199/408] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:27 2022] GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:31:27.645934 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-34ac4a60-5a64-430b-9643-757f9efc5764 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:27.646642 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-34ac4a60-5a64-430b-9643-757f9efc5764 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:27.653006 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-34ac4a60-5a64-430b-9643-757f9efc5764 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:27.653821 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-34ac4a60-5a64-430b-9643-757f9efc5764 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:27.654230 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-34ac4a60-5a64-430b-9643-757f9efc5764 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:27.655662 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-34ac4a60-5a64-430b-9643-757f9efc5764 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:28.022969 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-34ac4a60-5a64-430b-9643-757f9efc5764 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:28.034277 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-34ac4a60-5a64-430b-9643-757f9efc5764 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:28.039981 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-34ac4a60-5a64-430b-9643-757f9efc5764 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:28.039981 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-34ac4a60-5a64-430b-9643-757f9efc5764 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1725 microversion: 2.20 time: 0.397016 Jun 01 04:31:28.039981 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 210/409] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:27 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1725 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:31:28.596598 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-bff6a475-830b-48e7-a30f-dad851350adf tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:28.597211 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-bff6a475-830b-48e7-a30f-dad851350adf tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:28.603625 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bff6a475-830b-48e7-a30f-dad851350adf tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:28.607895 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bff6a475-830b-48e7-a30f-dad851350adf tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:28.607895 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bff6a475-830b-48e7-a30f-dad851350adf tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:28.607895 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bff6a475-830b-48e7-a30f-dad851350adf tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:28.800193 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-bff6a475-830b-48e7-a30f-dad851350adf tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:28.808788 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-bff6a475-830b-48e7-a30f-dad851350adf tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e" status: 200 len: 1266 microversion: 2.1 time: 0.216051 Jun 01 04:31:28.809387 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 200/410] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:28 2022] GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:31:29.057391 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-8a4e354a-311d-4cdd-aaa7-01c04c8ed8ab tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:29.057855 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-8a4e354a-311d-4cdd-aaa7-01c04c8ed8ab tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:29.063946 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8a4e354a-311d-4cdd-aaa7-01c04c8ed8ab tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:29.064396 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8a4e354a-311d-4cdd-aaa7-01c04c8ed8ab tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:29.065308 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8a4e354a-311d-4cdd-aaa7-01c04c8ed8ab tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:29.065616 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8a4e354a-311d-4cdd-aaa7-01c04c8ed8ab tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:29.208276 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-8a4e354a-311d-4cdd-aaa7-01c04c8ed8ab tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:29.216825 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-8a4e354a-311d-4cdd-aaa7-01c04c8ed8ab tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:29.218527 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-8a4e354a-311d-4cdd-aaa7-01c04c8ed8ab tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:29.220428 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-8a4e354a-311d-4cdd-aaa7-01c04c8ed8ab tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1725 microversion: 2.20 time: 0.168036 Jun 01 04:31:29.221444 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 211/411] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:29 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:31:29.826407 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-5bba9efe-cd8e-4112-a94f-bfb890617981 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:29.831453 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-5bba9efe-cd8e-4112-a94f-bfb890617981 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:29.834387 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5bba9efe-cd8e-4112-a94f-bfb890617981 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:29.834873 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5bba9efe-cd8e-4112-a94f-bfb890617981 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:29.835637 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5bba9efe-cd8e-4112-a94f-bfb890617981 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:29.836137 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5bba9efe-cd8e-4112-a94f-bfb890617981 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:29.969830 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-5bba9efe-cd8e-4112-a94f-bfb890617981 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:29.977941 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-5bba9efe-cd8e-4112-a94f-bfb890617981 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e" status: 200 len: 1266 microversion: 2.1 time: 0.155425 Jun 01 04:31:29.978597 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 201/412] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:29 2022] GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:31:30.239544 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-cc97ba6d-251d-494d-b183-e80a7d5de9de tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:30.240161 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-cc97ba6d-251d-494d-b183-e80a7d5de9de tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:30.245998 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-cc97ba6d-251d-494d-b183-e80a7d5de9de tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:30.246447 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-cc97ba6d-251d-494d-b183-e80a7d5de9de tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:30.247205 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-cc97ba6d-251d-494d-b183-e80a7d5de9de tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:30.247662 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-cc97ba6d-251d-494d-b183-e80a7d5de9de tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:30.372529 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-cc97ba6d-251d-494d-b183-e80a7d5de9de tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:30.380343 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-cc97ba6d-251d-494d-b183-e80a7d5de9de tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:30.381849 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-cc97ba6d-251d-494d-b183-e80a7d5de9de tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:30.382990 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-cc97ba6d-251d-494d-b183-e80a7d5de9de tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1746 microversion: 2.20 time: 0.148510 Jun 01 04:31:30.383601 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 212/413] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:30 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:31:30.996156 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-03bfa865-d4fc-49f3-a318-527bf708af1d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:30.996795 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-03bfa865-d4fc-49f3-a318-527bf708af1d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:31.004075 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-03bfa865-d4fc-49f3-a318-527bf708af1d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:31.004530 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-03bfa865-d4fc-49f3-a318-527bf708af1d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:31.005293 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-03bfa865-d4fc-49f3-a318-527bf708af1d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:31.005730 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-03bfa865-d4fc-49f3-a318-527bf708af1d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:31.137869 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-03bfa865-d4fc-49f3-a318-527bf708af1d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:31.149333 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-03bfa865-d4fc-49f3-a318-527bf708af1d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e" status: 200 len: 1266 microversion: 2.1 time: 0.156762 Jun 01 04:31:31.150184 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 202/414] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:30 2022] GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:31:31.401196 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-1eb5c085-7dcd-492a-b166-583ea43a38fd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:31.401716 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-1eb5c085-7dcd-492a-b166-583ea43a38fd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:31.407769 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1eb5c085-7dcd-492a-b166-583ea43a38fd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:31.408221 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1eb5c085-7dcd-492a-b166-583ea43a38fd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:31.408991 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1eb5c085-7dcd-492a-b166-583ea43a38fd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:31.409431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1eb5c085-7dcd-492a-b166-583ea43a38fd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:31.537939 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-1eb5c085-7dcd-492a-b166-583ea43a38fd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:31.545826 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-1eb5c085-7dcd-492a-b166-583ea43a38fd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:31.547359 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-1eb5c085-7dcd-492a-b166-583ea43a38fd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:31.549016 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-1eb5c085-7dcd-492a-b166-583ea43a38fd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1746 microversion: 2.20 time: 0.151331 Jun 01 04:31:31.549568 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 213/415] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:31 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:31:31.990668 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-f42611ad-886a-472a-95cb-5e824d06cc12 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-772954535", "imageRef": "14321baa-3ac5-4c53-8054-4945abce5b2d", "flavorRef": "452", "networks": [{"uuid": "42562544-f7d5-495e-a6f5-6fc15fd8a536"}]}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:31:32.041194 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.network.neutron [None req-f42611ad-886a-472a-95cb-5e824d06cc12 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] validate_networks() for [('42562544-f7d5-495e-a6f5-6fc15fd8a536', None, None, None, None, None)] {{(pid=118516) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 01 04:31:32.167577 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-7bf7ac6e-19ca-442f-b95f-1af429b85928 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:32.168205 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-7bf7ac6e-19ca-442f-b95f-1af429b85928 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:32.174162 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7bf7ac6e-19ca-442f-b95f-1af429b85928 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:32.174604 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7bf7ac6e-19ca-442f-b95f-1af429b85928 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:32.175382 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7bf7ac6e-19ca-442f-b95f-1af429b85928 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:32.175814 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7bf7ac6e-19ca-442f-b95f-1af429b85928 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:32.306251 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-7bf7ac6e-19ca-442f-b95f-1af429b85928 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:32.313720 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-7bf7ac6e-19ca-442f-b95f-1af429b85928 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e" status: 200 len: 1266 microversion: 2.1 time: 0.150192 Jun 01 04:31:32.314277 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 214/416] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:32 2022] GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:31:32.380749 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-f42611ad-886a-472a-95cb-5e824d06cc12 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Flavor limits 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 01 04:31:32.381163 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-f42611ad-886a-472a-95cb-5e824d06cc12 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Image limits 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 01 04:31:32.381628 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-f42611ad-886a-472a-95cb-5e824d06cc12 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Flavor pref 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 01 04:31:32.382028 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-f42611ad-886a-472a-95cb-5e824d06cc12 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Image pref 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 01 04:31:32.382433 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-f42611ad-886a-472a-95cb-5e824d06cc12 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 01 04:31:32.391010 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f42611ad-886a-472a-95cb-5e824d06cc12 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:32.391489 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f42611ad-886a-472a-95cb-5e824d06cc12 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:32.392791 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f42611ad-886a-472a-95cb-5e824d06cc12 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:32.393220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f42611ad-886a-472a-95cb-5e824d06cc12 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:32.409877 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-f42611ad-886a-472a-95cb-5e824d06cc12 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Getting quotas for project 7454aaeeba6b4a8c86a0446ae68dd4f1. Resources: {'ram', 'instances', 'cores'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:31:32.413786 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-f42611ad-886a-472a-95cb-5e824d06cc12 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Getting quotas for user e249c6bada9d4dcb91b83a0a29ad552d and project 7454aaeeba6b4a8c86a0446ae68dd4f1. Resources: {'ram', 'instances', 'cores'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:31:32.424540 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-f42611ad-886a-472a-95cb-5e824d06cc12 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Going to run 1 instances... {{(pid=118516) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 01 04:31:32.426694 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-f42611ad-886a-472a-95cb-5e824d06cc12 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: ee6bbca6-d73f-46d5-a3b9-684c864dbdaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14321baa-3ac5-4c53-8054-4945abce5b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 01 04:31:32.537387 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-f42611ad-886a-472a-95cb-5e824d06cc12 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.551379 Jun 01 04:31:32.538253 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 203/417] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 1 04:31:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 01 04:31:32.548050 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-4690bc9f-461b-4821-a789-6daa8e8cdb8e tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:32.548652 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-4690bc9f-461b-4821-a789-6daa8e8cdb8e tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: ee6bbca6-d73f-46d5-a3b9-684c864dbdaf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:32.550682 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell0:SELECT=2 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:31:32.566882 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-eb731a88-efed-4f23-bf3b-b22055dbba21 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:32.568191 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-eb731a88-efed-4f23-bf3b-b22055dbba21 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:32.575143 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-eb731a88-efed-4f23-bf3b-b22055dbba21 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:32.575678 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-eb731a88-efed-4f23-bf3b-b22055dbba21 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:32.576456 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-eb731a88-efed-4f23-bf3b-b22055dbba21 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:32.576893 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-eb731a88-efed-4f23-bf3b-b22055dbba21 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:32.606673 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-4690bc9f-461b-4821-a789-6daa8e8cdb8e tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:32.614877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-4690bc9f-461b-4821-a789-6daa8e8cdb8e tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf" status: 200 len: 1218 microversion: 2.1 time: 0.070533 Jun 01 04:31:32.615483 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 215/418] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:32 2022] GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:31:32.721492 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-eb731a88-efed-4f23-bf3b-b22055dbba21 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:32.729630 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-eb731a88-efed-4f23-bf3b-b22055dbba21 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:32.731147 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-eb731a88-efed-4f23-bf3b-b22055dbba21 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:32.732366 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-eb731a88-efed-4f23-bf3b-b22055dbba21 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1746 microversion: 2.20 time: 0.170252 Jun 01 04:31:32.732913 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 204/419] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:32 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1746 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:31:33.330619 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-7df4f468-4095-4f2e-b4e0-fb7ec5aec827 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:33.331220 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-7df4f468-4095-4f2e-b4e0-fb7ec5aec827 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:33.337576 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7df4f468-4095-4f2e-b4e0-fb7ec5aec827 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:33.338016 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7df4f468-4095-4f2e-b4e0-fb7ec5aec827 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:33.338878 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7df4f468-4095-4f2e-b4e0-fb7ec5aec827 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:33.339335 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7df4f468-4095-4f2e-b4e0-fb7ec5aec827 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:33.479192 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-7df4f468-4095-4f2e-b4e0-fb7ec5aec827 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:33.481493 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:31:33.487458 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-7df4f468-4095-4f2e-b4e0-fb7ec5aec827 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e" status: 200 len: 1266 microversion: 2.1 time: 0.161362 Jun 01 04:31:33.488286 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 216/420] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:33 2022] GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:31:33.632697 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-a0209100-ab9c-419d-a237-c599a5919e4e tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:33.633348 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-a0209100-ab9c-419d-a237-c599a5919e4e tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: ee6bbca6-d73f-46d5-a3b9-684c864dbdaf] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:33.640008 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a0209100-ab9c-419d-a237-c599a5919e4e tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:33.640462 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a0209100-ab9c-419d-a237-c599a5919e4e tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:33.641237 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a0209100-ab9c-419d-a237-c599a5919e4e tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:33.641673 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a0209100-ab9c-419d-a237-c599a5919e4e tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:33.705792 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-a0209100-ab9c-419d-a237-c599a5919e4e tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:33.713337 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-a0209100-ab9c-419d-a237-c599a5919e4e tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf" status: 200 len: 1222 microversion: 2.1 time: 0.084616 Jun 01 04:31:33.713899 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 205/421] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:33 2022] GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:31:33.751189 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a882187e-01da-4dd9-a8f0-6baebeed756e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:33.752948 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-a882187e-01da-4dd9-a8f0-6baebeed756e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:33.759527 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a882187e-01da-4dd9-a8f0-6baebeed756e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:33.774508 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a882187e-01da-4dd9-a8f0-6baebeed756e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:33.774508 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a882187e-01da-4dd9-a8f0-6baebeed756e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:33.774508 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a882187e-01da-4dd9-a8f0-6baebeed756e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:33.893439 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-a882187e-01da-4dd9-a8f0-6baebeed756e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:33.901741 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-a882187e-01da-4dd9-a8f0-6baebeed756e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:33.903268 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-a882187e-01da-4dd9-a8f0-6baebeed756e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:33.904472 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-a882187e-01da-4dd9-a8f0-6baebeed756e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1746 microversion: 2.20 time: 0.157757 Jun 01 04:31:33.905037 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 217/422] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:33 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:31:34.505051 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-33b4ae91-bfa2-4463-9ebd-4cf078d28a70 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:34.505603 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-33b4ae91-bfa2-4463-9ebd-4cf078d28a70 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:34.511874 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-33b4ae91-bfa2-4463-9ebd-4cf078d28a70 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:34.512326 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-33b4ae91-bfa2-4463-9ebd-4cf078d28a70 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:34.513089 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-33b4ae91-bfa2-4463-9ebd-4cf078d28a70 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:34.513527 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-33b4ae91-bfa2-4463-9ebd-4cf078d28a70 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:34.531997 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=100 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:31:34.651370 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-33b4ae91-bfa2-4463-9ebd-4cf078d28a70 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:34.654815 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-33b4ae91-bfa2-4463-9ebd-4cf078d28a70 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e" status: 200 len: 1266 microversion: 2.1 time: 0.153777 Jun 01 04:31:34.655385 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 206/423] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:34 2022] GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:31:34.730795 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-ca7f9c91-0672-47b6-a2e5-235b9e8604ff tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:34.731485 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-ca7f9c91-0672-47b6-a2e5-235b9e8604ff tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: ee6bbca6-d73f-46d5-a3b9-684c864dbdaf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:34.738760 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ca7f9c91-0672-47b6-a2e5-235b9e8604ff tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:34.739234 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ca7f9c91-0672-47b6-a2e5-235b9e8604ff tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:34.740042 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ca7f9c91-0672-47b6-a2e5-235b9e8604ff tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:34.740479 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ca7f9c91-0672-47b6-a2e5-235b9e8604ff tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:34.807836 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-ca7f9c91-0672-47b6-a2e5-235b9e8604ff tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:34.815265 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-ca7f9c91-0672-47b6-a2e5-235b9e8604ff tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf" status: 200 len: 1270 microversion: 2.1 time: 0.088656 Jun 01 04:31:34.815869 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 218/424] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:34 2022] GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:31:34.922947 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-1fae64ff-9c46-4db4-8db6-42e24127d2bb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:34.923580 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-1fae64ff-9c46-4db4-8db6-42e24127d2bb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:34.930655 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1fae64ff-9c46-4db4-8db6-42e24127d2bb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:34.931105 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1fae64ff-9c46-4db4-8db6-42e24127d2bb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:34.931892 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1fae64ff-9c46-4db4-8db6-42e24127d2bb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:34.932326 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1fae64ff-9c46-4db4-8db6-42e24127d2bb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:35.068575 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-1fae64ff-9c46-4db4-8db6-42e24127d2bb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:35.076505 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-1fae64ff-9c46-4db4-8db6-42e24127d2bb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:35.078033 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-1fae64ff-9c46-4db4-8db6-42e24127d2bb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:35.080002 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-1fae64ff-9c46-4db4-8db6-42e24127d2bb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1746 microversion: 2.20 time: 0.160610 Jun 01 04:31:35.080002 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 207/425] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:34 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:31:35.256979 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-fce506cd-4500-4049-9920-7d30cdfc97be req-0d18183e-df42-4045-8191-ab7856d19bdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c961e06b-1b03-4e97-8487-57adba5d5e16", "name": "network-vif-plugged", "status": "completed", "tag": "690b8ab1-955e-471f-b256-fa4681ea0480"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:31:35.265767 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-fce506cd-4500-4049-9920-7d30cdfc97be req-0d18183e-df42-4045-8191-ab7856d19bdd service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:35.266215 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-fce506cd-4500-4049-9920-7d30cdfc97be req-0d18183e-df42-4045-8191-ab7856d19bdd service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:35.277666 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-fce506cd-4500-4049-9920-7d30cdfc97be req-0d18183e-df42-4045-8191-ab7856d19bdd service nova] Creating event network-vif-plugged:690b8ab1-955e-471f-b256-fa4681ea0480 for instance c961e06b-1b03-4e97-8487-57adba5d5e16 on hv-cinder-66710 Jun 01 04:31:35.282468 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-fce506cd-4500-4049-9920-7d30cdfc97be req-0d18183e-df42-4045-8191-ab7856d19bdd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029210 Jun 01 04:31:35.283049 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 219/426] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:31:35.672232 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-ebfb3a0a-3936-472b-a29c-d978e359c7b8 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:35.672872 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-ebfb3a0a-3936-472b-a29c-d978e359c7b8 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:35.679421 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ebfb3a0a-3936-472b-a29c-d978e359c7b8 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:35.679873 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ebfb3a0a-3936-472b-a29c-d978e359c7b8 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:35.680636 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ebfb3a0a-3936-472b-a29c-d978e359c7b8 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:35.681074 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ebfb3a0a-3936-472b-a29c-d978e359c7b8 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:35.809759 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-ebfb3a0a-3936-472b-a29c-d978e359c7b8 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:35.817970 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-ebfb3a0a-3936-472b-a29c-d978e359c7b8 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e" status: 200 len: 1266 microversion: 2.1 time: 0.149564 Jun 01 04:31:35.818543 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 208/427] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:35 2022] GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:31:35.838270 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-0a62fdbb-a112-4d24-8d93-fde358261eaa tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:35.838958 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-0a62fdbb-a112-4d24-8d93-fde358261eaa tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: ee6bbca6-d73f-46d5-a3b9-684c864dbdaf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:35.845134 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0a62fdbb-a112-4d24-8d93-fde358261eaa tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:35.845574 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0a62fdbb-a112-4d24-8d93-fde358261eaa tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:35.846316 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0a62fdbb-a112-4d24-8d93-fde358261eaa tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:35.846742 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0a62fdbb-a112-4d24-8d93-fde358261eaa tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:35.907635 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-0a62fdbb-a112-4d24-8d93-fde358261eaa tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:35.915291 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-0a62fdbb-a112-4d24-8d93-fde358261eaa tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf" status: 200 len: 1278 microversion: 2.1 time: 0.081097 Jun 01 04:31:35.915876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 220/428] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:35 2022] GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf => generated 1278 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:31:36.098115 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-66301e34-98b3-4796-af2d-91e6961b6696 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:36.098723 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-66301e34-98b3-4796-af2d-91e6961b6696 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:36.104985 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-66301e34-98b3-4796-af2d-91e6961b6696 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:36.105442 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-66301e34-98b3-4796-af2d-91e6961b6696 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:36.106209 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-66301e34-98b3-4796-af2d-91e6961b6696 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:36.106651 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-66301e34-98b3-4796-af2d-91e6961b6696 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:36.232536 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-66301e34-98b3-4796-af2d-91e6961b6696 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:36.240871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-66301e34-98b3-4796-af2d-91e6961b6696 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:36.242395 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-66301e34-98b3-4796-af2d-91e6961b6696 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:36.243606 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-66301e34-98b3-4796-af2d-91e6961b6696 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1746 microversion: 2.20 time: 0.150095 Jun 01 04:31:36.244166 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 209/429] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:36 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:31:36.836591 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-d5675086-499b-47b6-bbf6-0c8fc26a223a tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:36.837430 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-d5675086-499b-47b6-bbf6-0c8fc26a223a tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:36.844670 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d5675086-499b-47b6-bbf6-0c8fc26a223a tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:36.848052 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d5675086-499b-47b6-bbf6-0c8fc26a223a tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:36.849102 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d5675086-499b-47b6-bbf6-0c8fc26a223a tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:36.849737 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d5675086-499b-47b6-bbf6-0c8fc26a223a tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:36.933445 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-07698d74-ad4f-4a8e-82e7-e3738d030242 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:36.934379 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-07698d74-ad4f-4a8e-82e7-e3738d030242 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: ee6bbca6-d73f-46d5-a3b9-684c864dbdaf] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:36.948918 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-07698d74-ad4f-4a8e-82e7-e3738d030242 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:36.949459 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-07698d74-ad4f-4a8e-82e7-e3738d030242 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:36.950369 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-07698d74-ad4f-4a8e-82e7-e3738d030242 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:36.950872 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-07698d74-ad4f-4a8e-82e7-e3738d030242 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:37.055634 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-07698d74-ad4f-4a8e-82e7-e3738d030242 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:37.072137 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-07698d74-ad4f-4a8e-82e7-e3738d030242 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf" status: 200 len: 1288 microversion: 2.1 time: 0.142140 Jun 01 04:31:37.076699 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 210/430] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:36 2022] GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf => generated 1288 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:31:37.144457 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-d5675086-499b-47b6-bbf6-0c8fc26a223a tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:37.153891 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-d5675086-499b-47b6-bbf6-0c8fc26a223a tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e" status: 200 len: 1266 microversion: 2.1 time: 0.322731 Jun 01 04:31:37.154471 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 221/431] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:36 2022] GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e => generated 1266 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:31:37.261934 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-10d0dcc4-be97-4951-b2ea-8271e5c32615 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:37.262535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-10d0dcc4-be97-4951-b2ea-8271e5c32615 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:37.269208 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-10d0dcc4-be97-4951-b2ea-8271e5c32615 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:37.269658 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-10d0dcc4-be97-4951-b2ea-8271e5c32615 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:37.270426 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-10d0dcc4-be97-4951-b2ea-8271e5c32615 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:37.270858 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-10d0dcc4-be97-4951-b2ea-8271e5c32615 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:37.505845 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-10d0dcc4-be97-4951-b2ea-8271e5c32615 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:37.518802 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-10d0dcc4-be97-4951-b2ea-8271e5c32615 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:37.520685 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-10d0dcc4-be97-4951-b2ea-8271e5c32615 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:37.522631 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-10d0dcc4-be97-4951-b2ea-8271e5c32615 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1741 microversion: 2.20 time: 0.264553 Jun 01 04:31:37.523791 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 211/432] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:37 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1741 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:31:38.094788 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-f01e4bea-2794-4da3-a3c1-dcbe89c67321 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:38.096131 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-f01e4bea-2794-4da3-a3c1-dcbe89c67321 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: ee6bbca6-d73f-46d5-a3b9-684c864dbdaf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:38.107762 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f01e4bea-2794-4da3-a3c1-dcbe89c67321 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:38.109875 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f01e4bea-2794-4da3-a3c1-dcbe89c67321 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:38.112402 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f01e4bea-2794-4da3-a3c1-dcbe89c67321 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:38.114301 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f01e4bea-2794-4da3-a3c1-dcbe89c67321 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:38.171486 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d6665a7a-ad4f-45fa-9f60-17909ea0e2d3 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:38.172850 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-d6665a7a-ad4f-45fa-9f60-17909ea0e2d3 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:38.195622 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d6665a7a-ad4f-45fa-9f60-17909ea0e2d3 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:38.202391 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d6665a7a-ad4f-45fa-9f60-17909ea0e2d3 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:38.202391 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d6665a7a-ad4f-45fa-9f60-17909ea0e2d3 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:38.202391 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d6665a7a-ad4f-45fa-9f60-17909ea0e2d3 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:38.290728 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-f01e4bea-2794-4da3-a3c1-dcbe89c67321 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:38.299109 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-f01e4bea-2794-4da3-a3c1-dcbe89c67321 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf" status: 200 len: 1318 microversion: 2.1 time: 0.208500 Jun 01 04:31:38.299969 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 222/433] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:38 2022] GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:31:38.476713 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-d6665a7a-ad4f-45fa-9f60-17909ea0e2d3 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:38.488022 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-d6665a7a-ad4f-45fa-9f60-17909ea0e2d3 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e" status: 200 len: 1266 microversion: 2.1 time: 0.320234 Jun 01 04:31:38.498057 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 212/434] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:38 2022] GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e => generated 1266 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:31:38.543520 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-491d7e0a-65ab-4a96-8a40-b6abfbefd9de tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:38.544367 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-491d7e0a-65ab-4a96-8a40-b6abfbefd9de tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:38.551053 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-491d7e0a-65ab-4a96-8a40-b6abfbefd9de tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:38.551693 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-491d7e0a-65ab-4a96-8a40-b6abfbefd9de tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:38.552650 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-491d7e0a-65ab-4a96-8a40-b6abfbefd9de tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:38.553275 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-491d7e0a-65ab-4a96-8a40-b6abfbefd9de tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:38.720399 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-cb3f27e7-4dbe-45f0-8802-999668e69a35 req-06af8ea1-0966-485b-9ddb-1468b7aaceae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee6bbca6-d73f-46d5-a3b9-684c864dbdaf", "tag": "8138db02-b358-48b3-8480-cfead95744b4"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:31:38.734018 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-cb3f27e7-4dbe-45f0-8802-999668e69a35 req-06af8ea1-0966-485b-9ddb-1468b7aaceae service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:38.734507 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-cb3f27e7-4dbe-45f0-8802-999668e69a35 req-06af8ea1-0966-485b-9ddb-1468b7aaceae service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:38.754026 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-cb3f27e7-4dbe-45f0-8802-999668e69a35 req-06af8ea1-0966-485b-9ddb-1468b7aaceae service nova] Creating event network-changed:8138db02-b358-48b3-8480-cfead95744b4 for instance ee6bbca6-d73f-46d5-a3b9-684c864dbdaf on hv-cinder-66710 Jun 01 04:31:38.781342 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-cb3f27e7-4dbe-45f0-8802-999668e69a35 req-06af8ea1-0966-485b-9ddb-1468b7aaceae service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068373 Jun 01 04:31:38.787693 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 213/435] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:31:38.825467 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-491d7e0a-65ab-4a96-8a40-b6abfbefd9de tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:38.838276 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-491d7e0a-65ab-4a96-8a40-b6abfbefd9de tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:38.847120 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-491d7e0a-65ab-4a96-8a40-b6abfbefd9de tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:38.851449 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-491d7e0a-65ab-4a96-8a40-b6abfbefd9de tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1741 microversion: 2.20 time: 0.310757 Jun 01 04:31:38.851449 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 223/436] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:38 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1741 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:31:39.321996 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-de9146cc-551d-4c01-b8ce-445fa5dfaa11 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:39.323254 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-de9146cc-551d-4c01-b8ce-445fa5dfaa11 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: ee6bbca6-d73f-46d5-a3b9-684c864dbdaf] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:39.337640 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-de9146cc-551d-4c01-b8ce-445fa5dfaa11 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:39.339337 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-de9146cc-551d-4c01-b8ce-445fa5dfaa11 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:39.342514 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-de9146cc-551d-4c01-b8ce-445fa5dfaa11 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:39.343474 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-de9146cc-551d-4c01-b8ce-445fa5dfaa11 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:39.506194 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-9e206b3d-033d-40ba-9b0b-777923c3bf32 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:39.507445 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-9e206b3d-033d-40ba-9b0b-777923c3bf32 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:39.525103 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9e206b3d-033d-40ba-9b0b-777923c3bf32 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:39.526073 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9e206b3d-033d-40ba-9b0b-777923c3bf32 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:39.526864 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9e206b3d-033d-40ba-9b0b-777923c3bf32 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:39.527323 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9e206b3d-033d-40ba-9b0b-777923c3bf32 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:39.635520 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-de9146cc-551d-4c01-b8ce-445fa5dfaa11 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:39.645330 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-de9146cc-551d-4c01-b8ce-445fa5dfaa11 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf" status: 200 len: 1318 microversion: 2.1 time: 0.332249 Jun 01 04:31:39.650179 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 214/437] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:39 2022] GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:31:39.722114 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-9e206b3d-033d-40ba-9b0b-777923c3bf32 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:39.731471 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-9e206b3d-033d-40ba-9b0b-777923c3bf32 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e" status: 200 len: 1266 microversion: 2.1 time: 0.229669 Jun 01 04:31:39.732535 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 224/438] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:39 2022] GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:31:39.869430 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-4068d82d-55b2-4e7a-8922-7e7e9f5b455c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:39.870041 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-4068d82d-55b2-4e7a-8922-7e7e9f5b455c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:39.876425 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4068d82d-55b2-4e7a-8922-7e7e9f5b455c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:39.877611 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4068d82d-55b2-4e7a-8922-7e7e9f5b455c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:39.878566 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4068d82d-55b2-4e7a-8922-7e7e9f5b455c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:39.879261 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4068d82d-55b2-4e7a-8922-7e7e9f5b455c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:40.050034 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-4068d82d-55b2-4e7a-8922-7e7e9f5b455c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:40.066743 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-4068d82d-55b2-4e7a-8922-7e7e9f5b455c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:40.069169 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-4068d82d-55b2-4e7a-8922-7e7e9f5b455c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:40.075855 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-4068d82d-55b2-4e7a-8922-7e7e9f5b455c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1741 microversion: 2.20 time: 0.206889 Jun 01 04:31:40.077860 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 215/439] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:39 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1741 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:31:40.666533 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-b4a2f759-8f7f-440a-933b-866dd4c13ce3 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:40.668639 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-b4a2f759-8f7f-440a-933b-866dd4c13ce3 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: ee6bbca6-d73f-46d5-a3b9-684c864dbdaf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:40.676024 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b4a2f759-8f7f-440a-933b-866dd4c13ce3 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:40.676436 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b4a2f759-8f7f-440a-933b-866dd4c13ce3 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:40.677225 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b4a2f759-8f7f-440a-933b-866dd4c13ce3 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:40.677659 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b4a2f759-8f7f-440a-933b-866dd4c13ce3 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:40.750394 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-ab779b45-04b1-4586-acc5-e39b2d616395 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:40.751041 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-ab779b45-04b1-4586-acc5-e39b2d616395 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:40.760719 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ab779b45-04b1-4586-acc5-e39b2d616395 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:40.761239 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ab779b45-04b1-4586-acc5-e39b2d616395 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:40.762558 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ab779b45-04b1-4586-acc5-e39b2d616395 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:40.763660 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ab779b45-04b1-4586-acc5-e39b2d616395 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:40.818529 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-b4a2f759-8f7f-440a-933b-866dd4c13ce3 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:40.830760 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-b4a2f759-8f7f-440a-933b-866dd4c13ce3 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf" status: 200 len: 1318 microversion: 2.1 time: 0.167511 Jun 01 04:31:40.880499 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 225/440] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:40 2022] GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:31:40.909525 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-ab779b45-04b1-4586-acc5-e39b2d616395 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:40.918074 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-ab779b45-04b1-4586-acc5-e39b2d616395 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e" status: 200 len: 1266 microversion: 2.1 time: 0.171947 Jun 01 04:31:40.918639 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 216/441] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:40 2022] GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:31:41.096015 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-f4983417-6916-456c-8171-aa097f5ae5e6 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:41.096699 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-f4983417-6916-456c-8171-aa097f5ae5e6 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:41.102706 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f4983417-6916-456c-8171-aa097f5ae5e6 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:41.103154 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f4983417-6916-456c-8171-aa097f5ae5e6 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:41.103950 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f4983417-6916-456c-8171-aa097f5ae5e6 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:41.104449 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f4983417-6916-456c-8171-aa097f5ae5e6 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:41.234502 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-f4983417-6916-456c-8171-aa097f5ae5e6 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:41.243848 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-f4983417-6916-456c-8171-aa097f5ae5e6 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:41.245363 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-f4983417-6916-456c-8171-aa097f5ae5e6 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:41.246703 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-f4983417-6916-456c-8171-aa097f5ae5e6 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1741 microversion: 2.20 time: 0.154627 Jun 01 04:31:41.247251 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 226/442] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:41 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1741 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:31:41.649410 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-a6a0ad3a-e669-477c-bf75-73a3330dcb62 req-c01f79bf-f8e0-4e6a-b788-e0e93f1df25f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a724f928-21b8-4379-a078-600dc46ce06e", "name": "network-vif-plugged", "status": "completed", "tag": "52757b70-1a8f-4bea-8511-23d4b4a70ddf"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:31:41.660074 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-a6a0ad3a-e669-477c-bf75-73a3330dcb62 req-c01f79bf-f8e0-4e6a-b788-e0e93f1df25f service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:41.660679 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-a6a0ad3a-e669-477c-bf75-73a3330dcb62 req-c01f79bf-f8e0-4e6a-b788-e0e93f1df25f service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:41.672891 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-a6a0ad3a-e669-477c-bf75-73a3330dcb62 req-c01f79bf-f8e0-4e6a-b788-e0e93f1df25f service nova] Creating event network-vif-plugged:52757b70-1a8f-4bea-8511-23d4b4a70ddf for instance a724f928-21b8-4379-a078-600dc46ce06e on hv-cinder-66710 Jun 01 04:31:41.679218 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-a6a0ad3a-e669-477c-bf75-73a3330dcb62 req-c01f79bf-f8e0-4e6a-b788-e0e93f1df25f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034007 Jun 01 04:31:41.680441 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 217/443] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:31:41.854281 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-26aa135d-90a9-4550-8fb7-f1aaa07cd26c tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:41.854902 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-26aa135d-90a9-4550-8fb7-f1aaa07cd26c tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: ee6bbca6-d73f-46d5-a3b9-684c864dbdaf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:41.858391 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:31:41.863069 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-26aa135d-90a9-4550-8fb7-f1aaa07cd26c tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:41.863560 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-26aa135d-90a9-4550-8fb7-f1aaa07cd26c tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:41.864349 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-26aa135d-90a9-4550-8fb7-f1aaa07cd26c tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:41.864794 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-26aa135d-90a9-4550-8fb7-f1aaa07cd26c tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:41.936358 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-6255eaaf-366e-4afa-89b4-c18281680008 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:41.937071 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-6255eaaf-366e-4afa-89b4-c18281680008 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:41.962165 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6255eaaf-366e-4afa-89b4-c18281680008 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:41.962710 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6255eaaf-366e-4afa-89b4-c18281680008 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:41.963628 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6255eaaf-366e-4afa-89b4-c18281680008 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:41.964193 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6255eaaf-366e-4afa-89b4-c18281680008 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:42.040418 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-26aa135d-90a9-4550-8fb7-f1aaa07cd26c tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:42.053891 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-26aa135d-90a9-4550-8fb7-f1aaa07cd26c tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf" status: 200 len: 1318 microversion: 2.1 time: 0.203643 Jun 01 04:31:42.055356 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 227/444] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:41 2022] GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:31:42.216354 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-6255eaaf-366e-4afa-89b4-c18281680008 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:42.229773 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-6255eaaf-366e-4afa-89b4-c18281680008 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e" status: 200 len: 1266 microversion: 2.1 time: 0.298667 Jun 01 04:31:42.231134 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 218/445] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:41 2022] GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e => generated 1266 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:31:42.269391 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-e2c646c2-2a28-47ca-969a-66ca8d170965 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:42.270628 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-e2c646c2-2a28-47ca-969a-66ca8d170965 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:42.280511 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e2c646c2-2a28-47ca-969a-66ca8d170965 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:42.281064 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e2c646c2-2a28-47ca-969a-66ca8d170965 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:42.281915 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e2c646c2-2a28-47ca-969a-66ca8d170965 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:42.282422 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e2c646c2-2a28-47ca-969a-66ca8d170965 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:42.516810 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-e2c646c2-2a28-47ca-969a-66ca8d170965 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:42.526849 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-e2c646c2-2a28-47ca-969a-66ca8d170965 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:42.528447 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-e2c646c2-2a28-47ca-969a-66ca8d170965 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:42.529631 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-e2c646c2-2a28-47ca-969a-66ca8d170965 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1741 microversion: 2.20 time: 0.267772 Jun 01 04:31:42.530181 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 228/446] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:42 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1741 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:31:43.097259 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-9cd3ccb7-feec-4b00-b433-17ab81f68cc7 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:43.098268 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-9cd3ccb7-feec-4b00-b433-17ab81f68cc7 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: ee6bbca6-d73f-46d5-a3b9-684c864dbdaf] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:43.103000 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell0:SELECT=2 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:31:43.104279 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell0:SELECT=6 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:31:43.106007 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:31:43.109924 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9cd3ccb7-feec-4b00-b433-17ab81f68cc7 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:43.116467 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9cd3ccb7-feec-4b00-b433-17ab81f68cc7 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:43.116467 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9cd3ccb7-feec-4b00-b433-17ab81f68cc7 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:43.116467 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9cd3ccb7-feec-4b00-b433-17ab81f68cc7 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:43.249722 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-945f73f7-dc3d-488c-8750-b7acfd5cb987 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:43.250386 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-945f73f7-dc3d-488c-8750-b7acfd5cb987 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:43.261677 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell0:SELECT=10 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:31:43.273526 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-945f73f7-dc3d-488c-8750-b7acfd5cb987 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:43.273526 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-945f73f7-dc3d-488c-8750-b7acfd5cb987 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:43.273526 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-945f73f7-dc3d-488c-8750-b7acfd5cb987 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:43.273526 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-945f73f7-dc3d-488c-8750-b7acfd5cb987 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:43.355999 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-9cd3ccb7-feec-4b00-b433-17ab81f68cc7 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:43.375260 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-9cd3ccb7-feec-4b00-b433-17ab81f68cc7 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf" status: 200 len: 1318 microversion: 2.1 time: 0.280994 Jun 01 04:31:43.375260 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 219/447] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:43 2022] GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:31:43.500595 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-945f73f7-dc3d-488c-8750-b7acfd5cb987 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:43.511339 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-945f73f7-dc3d-488c-8750-b7acfd5cb987 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e" status: 200 len: 1266 microversion: 2.1 time: 0.266996 Jun 01 04:31:43.521344 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 229/448] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:43 2022] GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e => generated 1266 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:31:43.549893 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-2e25a21c-cc49-4e9d-af25-fb22ed6464c9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:43.550508 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-2e25a21c-cc49-4e9d-af25-fb22ed6464c9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:43.556664 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2e25a21c-cc49-4e9d-af25-fb22ed6464c9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:43.557161 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2e25a21c-cc49-4e9d-af25-fb22ed6464c9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:43.557907 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2e25a21c-cc49-4e9d-af25-fb22ed6464c9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:43.558346 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2e25a21c-cc49-4e9d-af25-fb22ed6464c9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:43.741847 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-2e25a21c-cc49-4e9d-af25-fb22ed6464c9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:43.759066 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-2e25a21c-cc49-4e9d-af25-fb22ed6464c9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:43.761065 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-2e25a21c-cc49-4e9d-af25-fb22ed6464c9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:43.762295 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-2e25a21c-cc49-4e9d-af25-fb22ed6464c9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1741 microversion: 2.20 time: 0.216837 Jun 01 04:31:43.776625 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 220/449] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:43 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1741 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:31:44.406218 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-4015f756-7ad3-4485-9dfb-babec0c1099c tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:44.406783 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-4015f756-7ad3-4485-9dfb-babec0c1099c tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: ee6bbca6-d73f-46d5-a3b9-684c864dbdaf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:44.413608 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4015f756-7ad3-4485-9dfb-babec0c1099c tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:44.414288 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4015f756-7ad3-4485-9dfb-babec0c1099c tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:44.415096 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4015f756-7ad3-4485-9dfb-babec0c1099c tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:44.415570 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4015f756-7ad3-4485-9dfb-babec0c1099c tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:44.528793 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-fdebb851-24c0-46b5-8158-9ab99b4d52cc tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:44.529414 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-fdebb851-24c0-46b5-8158-9ab99b4d52cc tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:44.536340 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fdebb851-24c0-46b5-8158-9ab99b4d52cc tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:44.536787 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fdebb851-24c0-46b5-8158-9ab99b4d52cc tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:44.537554 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fdebb851-24c0-46b5-8158-9ab99b4d52cc tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:44.538159 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fdebb851-24c0-46b5-8158-9ab99b4d52cc tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:44.557232 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-4015f756-7ad3-4485-9dfb-babec0c1099c tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:44.565374 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-4015f756-7ad3-4485-9dfb-babec0c1099c tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf" status: 200 len: 1318 microversion: 2.1 time: 0.163159 Jun 01 04:31:44.565934 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 230/450] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:44 2022] GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:31:44.687740 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-fdebb851-24c0-46b5-8158-9ab99b4d52cc tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:44.697994 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-fdebb851-24c0-46b5-8158-9ab99b4d52cc tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e" status: 200 len: 1266 microversion: 2.1 time: 0.173332 Jun 01 04:31:44.698708 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 221/451] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:44 2022] GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:31:44.800386 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-be639a0e-348a-4dc1-bb24-e24e601743ae tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:44.801358 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-be639a0e-348a-4dc1-bb24-e24e601743ae tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:44.807982 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-be639a0e-348a-4dc1-bb24-e24e601743ae tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:44.808755 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-be639a0e-348a-4dc1-bb24-e24e601743ae tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:44.809617 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-be639a0e-348a-4dc1-bb24-e24e601743ae tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:44.810146 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-be639a0e-348a-4dc1-bb24-e24e601743ae tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:44.981845 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-be639a0e-348a-4dc1-bb24-e24e601743ae tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:44.992362 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-be639a0e-348a-4dc1-bb24-e24e601743ae tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:44.993974 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-be639a0e-348a-4dc1-bb24-e24e601743ae tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:44.995264 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-be639a0e-348a-4dc1-bb24-e24e601743ae tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1741 microversion: 2.20 time: 0.199002 Jun 01 04:31:44.995995 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 231/452] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:44 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1741 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:31:45.583163 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-0a70974a-5f05-49ec-8f9e-846a1c7cd74d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:45.584486 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-0a70974a-5f05-49ec-8f9e-846a1c7cd74d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: ee6bbca6-d73f-46d5-a3b9-684c864dbdaf] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:45.591456 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0a70974a-5f05-49ec-8f9e-846a1c7cd74d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:45.592139 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0a70974a-5f05-49ec-8f9e-846a1c7cd74d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:45.593273 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0a70974a-5f05-49ec-8f9e-846a1c7cd74d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:45.593933 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0a70974a-5f05-49ec-8f9e-846a1c7cd74d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:45.716359 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a127b6d7-db50-4430-a01e-b15e1de6721c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:45.717787 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-a127b6d7-db50-4430-a01e-b15e1de6721c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:45.725365 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a127b6d7-db50-4430-a01e-b15e1de6721c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:45.726155 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a127b6d7-db50-4430-a01e-b15e1de6721c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:45.727144 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a127b6d7-db50-4430-a01e-b15e1de6721c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:45.728028 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a127b6d7-db50-4430-a01e-b15e1de6721c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:45.741548 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-0a70974a-5f05-49ec-8f9e-846a1c7cd74d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:45.752204 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-0a70974a-5f05-49ec-8f9e-846a1c7cd74d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf" status: 200 len: 1318 microversion: 2.1 time: 0.173813 Jun 01 04:31:45.762308 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 222/453] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:45 2022] GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:31:45.890138 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-a127b6d7-db50-4430-a01e-b15e1de6721c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:45.899102 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-a127b6d7-db50-4430-a01e-b15e1de6721c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e" status: 200 len: 1452 microversion: 2.1 time: 0.186531 Jun 01 04:31:45.899839 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 232/454] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:45 2022] GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e => generated 1452 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:31:45.921486 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-f7643297-972f-4412-ab69-7e1f0f4c1fec tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:45.922500 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-f7643297-972f-4412-ab69-7e1f0f4c1fec tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:45.928881 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f7643297-972f-4412-ab69-7e1f0f4c1fec tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:45.929605 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f7643297-972f-4412-ab69-7e1f0f4c1fec tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:45.930628 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f7643297-972f-4412-ab69-7e1f0f4c1fec tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:45.931253 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f7643297-972f-4412-ab69-7e1f0f4c1fec tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:46.016722 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-4a6e91c8-c429-4d73-a0e4-c08b1a970b46 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:46.018317 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-4a6e91c8-c429-4d73-a0e4-c08b1a970b46 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:46.030588 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4a6e91c8-c429-4d73-a0e4-c08b1a970b46 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:46.031392 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4a6e91c8-c429-4d73-a0e4-c08b1a970b46 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:46.032340 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4a6e91c8-c429-4d73-a0e4-c08b1a970b46 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:46.033628 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4a6e91c8-c429-4d73-a0e4-c08b1a970b46 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:46.135007 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-f7643297-972f-4412-ab69-7e1f0f4c1fec tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:46.143162 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-f7643297-972f-4412-ab69-7e1f0f4c1fec tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e" status: 200 len: 1452 microversion: 2.1 time: 0.224996 Jun 01 04:31:46.143770 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 223/455] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:45 2022] GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e => generated 1452 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:31:46.148293 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-314ad6ee-ad6f-49a0-97fd-1165d4ec033b req-eb3fb8c9-bcdd-4f21-9a54-7fdf682bbe4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6bbca6-d73f-46d5-a3b9-684c864dbdaf", "name": "network-vif-plugged", "status": "completed", "tag": "8138db02-b358-48b3-8480-cfead95744b4"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:31:46.156353 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-314ad6ee-ad6f-49a0-97fd-1165d4ec033b req-eb3fb8c9-bcdd-4f21-9a54-7fdf682bbe4a service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:46.156802 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-314ad6ee-ad6f-49a0-97fd-1165d4ec033b req-eb3fb8c9-bcdd-4f21-9a54-7fdf682bbe4a service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:46.180235 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-314ad6ee-ad6f-49a0-97fd-1165d4ec033b req-eb3fb8c9-bcdd-4f21-9a54-7fdf682bbe4a service nova] Creating event network-vif-plugged:8138db02-b358-48b3-8480-cfead95744b4 for instance ee6bbca6-d73f-46d5-a3b9-684c864dbdaf on hv-cinder-66710 Jun 01 04:31:46.196829 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-314ad6ee-ad6f-49a0-97fd-1165d4ec033b req-eb3fb8c9-bcdd-4f21-9a54-7fdf682bbe4a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051707 Jun 01 04:31:46.197649 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 224/456] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:31:46.256387 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-4a6e91c8-c429-4d73-a0e4-c08b1a970b46 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:46.273383 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-4a6e91c8-c429-4d73-a0e4-c08b1a970b46 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:46.279530 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-4a6e91c8-c429-4d73-a0e4-c08b1a970b46 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:46.284582 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-4a6e91c8-c429-4d73-a0e4-c08b1a970b46 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1741 microversion: 2.20 time: 0.272394 Jun 01 04:31:46.285558 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 233/457] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:46 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1741 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:31:46.771251 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-8a31d6eb-de90-419a-92fe-41253c3e43f0 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:46.771986 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-8a31d6eb-de90-419a-92fe-41253c3e43f0 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: ee6bbca6-d73f-46d5-a3b9-684c864dbdaf] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:46.781597 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8a31d6eb-de90-419a-92fe-41253c3e43f0 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:46.782295 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8a31d6eb-de90-419a-92fe-41253c3e43f0 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:46.783823 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8a31d6eb-de90-419a-92fe-41253c3e43f0 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:46.784418 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8a31d6eb-de90-419a-92fe-41253c3e43f0 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:46.789335 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=100 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:31:46.975432 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-8a31d6eb-de90-419a-92fe-41253c3e43f0 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:46.983739 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-8a31d6eb-de90-419a-92fe-41253c3e43f0 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf" status: 200 len: 1318 microversion: 2.1 time: 0.216624 Jun 01 04:31:46.984329 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 225/458] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:46 2022] GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:31:47.310811 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-acb79c56-df02-4697-85e3-19bb9a3828f5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:47.311527 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-acb79c56-df02-4697-85e3-19bb9a3828f5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:47.320636 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-acb79c56-df02-4697-85e3-19bb9a3828f5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:47.321194 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-acb79c56-df02-4697-85e3-19bb9a3828f5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:47.322057 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-acb79c56-df02-4697-85e3-19bb9a3828f5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:47.322562 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-acb79c56-df02-4697-85e3-19bb9a3828f5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:47.325786 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=100 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:31:47.574031 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-acb79c56-df02-4697-85e3-19bb9a3828f5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:47.583138 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-acb79c56-df02-4697-85e3-19bb9a3828f5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:47.584789 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-acb79c56-df02-4697-85e3-19bb9a3828f5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:47.586070 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-acb79c56-df02-4697-85e3-19bb9a3828f5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1741 microversion: 2.20 time: 0.279937 Jun 01 04:31:47.592208 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 234/459] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:47 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1741 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:31:48.005018 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-6a7f68af-9e94-4fb8-aeaa-7c3fbae123ea tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:48.005599 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-6a7f68af-9e94-4fb8-aeaa-7c3fbae123ea tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: ee6bbca6-d73f-46d5-a3b9-684c864dbdaf] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:48.012163 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6a7f68af-9e94-4fb8-aeaa-7c3fbae123ea tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:48.017548 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6a7f68af-9e94-4fb8-aeaa-7c3fbae123ea tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:48.017548 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6a7f68af-9e94-4fb8-aeaa-7c3fbae123ea tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:48.017548 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6a7f68af-9e94-4fb8-aeaa-7c3fbae123ea tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:48.154545 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-6a7f68af-9e94-4fb8-aeaa-7c3fbae123ea tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:48.163182 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-6a7f68af-9e94-4fb8-aeaa-7c3fbae123ea tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf" status: 200 len: 1318 microversion: 2.1 time: 0.162775 Jun 01 04:31:48.176024 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 226/460] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:47 2022] GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:31:48.605154 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-16d3895c-2429-47cb-84ec-82272e0dc12e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:48.605940 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-16d3895c-2429-47cb-84ec-82272e0dc12e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:48.613486 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-16d3895c-2429-47cb-84ec-82272e0dc12e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:48.614281 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-16d3895c-2429-47cb-84ec-82272e0dc12e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:48.615867 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-16d3895c-2429-47cb-84ec-82272e0dc12e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:48.616950 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-16d3895c-2429-47cb-84ec-82272e0dc12e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:49.075227 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-16d3895c-2429-47cb-84ec-82272e0dc12e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:49.083795 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-16d3895c-2429-47cb-84ec-82272e0dc12e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:49.085317 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-16d3895c-2429-47cb-84ec-82272e0dc12e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:49.086497 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-16d3895c-2429-47cb-84ec-82272e0dc12e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1741 microversion: 2.20 time: 0.485783 Jun 01 04:31:49.087154 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 235/461] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:48 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1741 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:31:49.194510 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-1bf8476a-5323-47ed-b8b0-18961d808acf tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:49.195849 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-1bf8476a-5323-47ed-b8b0-18961d808acf tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: ee6bbca6-d73f-46d5-a3b9-684c864dbdaf] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:49.203068 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1bf8476a-5323-47ed-b8b0-18961d808acf tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:49.203534 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1bf8476a-5323-47ed-b8b0-18961d808acf tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:49.204402 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1bf8476a-5323-47ed-b8b0-18961d808acf tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:49.205601 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1bf8476a-5323-47ed-b8b0-18961d808acf tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:49.355446 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-1bf8476a-5323-47ed-b8b0-18961d808acf tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:49.365312 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-1bf8476a-5323-47ed-b8b0-18961d808acf tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf" status: 200 len: 1506 microversion: 2.1 time: 0.175655 Jun 01 04:31:49.378159 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 227/462] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:31:49 2022] GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:31:49.382953 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-1dd6b7ff-1111-4630-afd7-83dc55e924a3 req-4f51615f-8e87-43ab-b9a3-990f11a44fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a724f928-21b8-4379-a078-600dc46ce06e", "tag": "52757b70-1a8f-4bea-8511-23d4b4a70ddf"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:31:49.391891 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-1dd6b7ff-1111-4630-afd7-83dc55e924a3 req-4f51615f-8e87-43ab-b9a3-990f11a44fb3 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:49.392592 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-1dd6b7ff-1111-4630-afd7-83dc55e924a3 req-4f51615f-8e87-43ab-b9a3-990f11a44fb3 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:49.407922 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-1dd6b7ff-1111-4630-afd7-83dc55e924a3 req-4f51615f-8e87-43ab-b9a3-990f11a44fb3 service nova] Creating event network-changed:52757b70-1a8f-4bea-8511-23d4b4a70ddf for instance a724f928-21b8-4379-a078-600dc46ce06e on hv-cinder-66710 Jun 01 04:31:49.413632 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-1dd6b7ff-1111-4630-afd7-83dc55e924a3 req-4f51615f-8e87-43ab-b9a3-990f11a44fb3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034186 Jun 01 04:31:49.414758 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 236/463] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:31:50.110290 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b96d175f-c4e1-4992-a840-1c4b44caf097 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:50.115587 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-b96d175f-c4e1-4992-a840-1c4b44caf097 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:50.117515 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b96d175f-c4e1-4992-a840-1c4b44caf097 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:50.118000 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b96d175f-c4e1-4992-a840-1c4b44caf097 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:50.118779 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b96d175f-c4e1-4992-a840-1c4b44caf097 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:50.119220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b96d175f-c4e1-4992-a840-1c4b44caf097 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:50.337095 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b96d175f-c4e1-4992-a840-1c4b44caf097 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:50.347465 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b96d175f-c4e1-4992-a840-1c4b44caf097 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:50.349166 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b96d175f-c4e1-4992-a840-1c4b44caf097 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:50.350461 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-b96d175f-c4e1-4992-a840-1c4b44caf097 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1741 microversion: 2.20 time: 0.244230 Jun 01 04:31:50.351120 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 228/464] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:50 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1741 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:31:51.369468 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-3e6cd4ff-c314-453f-9e2b-5e9a416528cd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:51.370160 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-3e6cd4ff-c314-453f-9e2b-5e9a416528cd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:51.377180 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3e6cd4ff-c314-453f-9e2b-5e9a416528cd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:51.377638 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3e6cd4ff-c314-453f-9e2b-5e9a416528cd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:51.378403 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3e6cd4ff-c314-453f-9e2b-5e9a416528cd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:51.378843 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3e6cd4ff-c314-453f-9e2b-5e9a416528cd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:51.513832 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-3e6cd4ff-c314-453f-9e2b-5e9a416528cd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:51.522300 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-3e6cd4ff-c314-453f-9e2b-5e9a416528cd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:51.523832 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-3e6cd4ff-c314-453f-9e2b-5e9a416528cd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:51.524988 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-3e6cd4ff-c314-453f-9e2b-5e9a416528cd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1723 microversion: 2.20 time: 0.159824 Jun 01 04:31:51.525533 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 237/465] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:51 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:31:52.543047 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-90771e66-a054-42ae-97ea-214733a1cb26 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:52.544087 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-90771e66-a054-42ae-97ea-214733a1cb26 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:52.550664 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-90771e66-a054-42ae-97ea-214733a1cb26 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:52.551108 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-90771e66-a054-42ae-97ea-214733a1cb26 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:52.551900 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-90771e66-a054-42ae-97ea-214733a1cb26 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:52.552337 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-90771e66-a054-42ae-97ea-214733a1cb26 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:52.684098 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-90771e66-a054-42ae-97ea-214733a1cb26 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:52.692805 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-90771e66-a054-42ae-97ea-214733a1cb26 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:52.694330 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-90771e66-a054-42ae-97ea-214733a1cb26 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:52.695539 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-90771e66-a054-42ae-97ea-214733a1cb26 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1723 microversion: 2.20 time: 0.156357 Jun 01 04:31:52.696095 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 229/466] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:52 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:31:53.713367 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-bbe9c224-54c0-4831-ab2c-11c6aa3c24f0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:53.713917 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-bbe9c224-54c0-4831-ab2c-11c6aa3c24f0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:53.720126 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bbe9c224-54c0-4831-ab2c-11c6aa3c24f0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:53.720570 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bbe9c224-54c0-4831-ab2c-11c6aa3c24f0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:53.721835 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bbe9c224-54c0-4831-ab2c-11c6aa3c24f0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:53.722273 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bbe9c224-54c0-4831-ab2c-11c6aa3c24f0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:53.871953 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-bbe9c224-54c0-4831-ab2c-11c6aa3c24f0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:53.880642 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-bbe9c224-54c0-4831-ab2c-11c6aa3c24f0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:53.882143 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-bbe9c224-54c0-4831-ab2c-11c6aa3c24f0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:53.883355 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-bbe9c224-54c0-4831-ab2c-11c6aa3c24f0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1726 microversion: 2.20 time: 0.173939 Jun 01 04:31:53.883898 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 238/467] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:53 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:31:53.901616 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d971cc5a-edbe-49c0-8dd9-a14f93516c56 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98ac8378-a18b-4f21-b21a-78150d0ec68e"}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:31:53.902756 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-d971cc5a-edbe-49c0-8dd9-a14f93516c56 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:53.909980 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d971cc5a-edbe-49c0-8dd9-a14f93516c56 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:53.910458 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d971cc5a-edbe-49c0-8dd9-a14f93516c56 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:53.910707 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-0bcf690c-8e87-48bd-9732-b54f1fc675ae req-f926fcdf-eb2c-418e-ba79-ee647504e7d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c961e06b-1b03-4e97-8487-57adba5d5e16", "name": "network-vif-unplugged", "status": "completed", "tag": "690b8ab1-955e-471f-b256-fa4681ea0480"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:31:53.911337 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d971cc5a-edbe-49c0-8dd9-a14f93516c56 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:53.911787 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d971cc5a-edbe-49c0-8dd9-a14f93516c56 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:53.919061 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-0bcf690c-8e87-48bd-9732-b54f1fc675ae req-f926fcdf-eb2c-418e-ba79-ee647504e7d1 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:53.919536 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-0bcf690c-8e87-48bd-9732-b54f1fc675ae req-f926fcdf-eb2c-418e-ba79-ee647504e7d1 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:53.930815 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-0bcf690c-8e87-48bd-9732-b54f1fc675ae req-f926fcdf-eb2c-418e-ba79-ee647504e7d1 service nova] Creating event network-vif-unplugged:690b8ab1-955e-471f-b256-fa4681ea0480 for instance c961e06b-1b03-4e97-8487-57adba5d5e16 on hv-cinder-66710 Jun 01 04:31:53.935662 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-0bcf690c-8e87-48bd-9732-b54f1fc675ae req-f926fcdf-eb2c-418e-ba79-ee647504e7d1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032145 Jun 01 04:31:53.936242 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 239/468] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:31:54.883772 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-d971cc5a-edbe-49c0-8dd9-a14f93516c56 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "POST /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.986044 Jun 01 04:31:54.884398 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 230/469] 10.222.0.18 () {62 vars in 1363 bytes} [Wed Jun 1 04:31:53 2022] POST /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16/os-volume_attachments => generated 188 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 01 04:31:55.008060 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-d8920ad6-35d5-4ffa-ac34-6213482513cd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:31:55.008711 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-d8920ad6-35d5-4ffa-ac34-6213482513cd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:55.014935 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d8920ad6-35d5-4ffa-ac34-6213482513cd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:55.015426 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d8920ad6-35d5-4ffa-ac34-6213482513cd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:55.016196 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d8920ad6-35d5-4ffa-ac34-6213482513cd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:55.016638 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d8920ad6-35d5-4ffa-ac34-6213482513cd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:55.296058 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-d8920ad6-35d5-4ffa-ac34-6213482513cd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "POST /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16/action" status: 202 len: 0 microversion: 2.20 time: 0.292091 Jun 01 04:31:55.298606 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 240/470] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Jun 1 04:31:55 2022] POST /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 01 04:31:55.306497 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-fd837051-fd0c-4433-b6ac-75628c4f5583 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:55.307199 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-fd837051-fd0c-4433-b6ac-75628c4f5583 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:55.314734 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fd837051-fd0c-4433-b6ac-75628c4f5583 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:55.315226 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fd837051-fd0c-4433-b6ac-75628c4f5583 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:55.316316 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fd837051-fd0c-4433-b6ac-75628c4f5583 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:55.316760 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fd837051-fd0c-4433-b6ac-75628c4f5583 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:55.466255 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-fd837051-fd0c-4433-b6ac-75628c4f5583 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:55.475472 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-fd837051-fd0c-4433-b6ac-75628c4f5583 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:55.477008 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-fd837051-fd0c-4433-b6ac-75628c4f5583 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:55.478441 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-fd837051-fd0c-4433-b6ac-75628c4f5583 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1752 microversion: 2.20 time: 0.176060 Jun 01 04:31:55.479013 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 231/471] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:55 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1752 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:31:56.496872 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-e3923101-c5cd-45c6-b18a-4cee9f522fb4 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:56.497476 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-e3923101-c5cd-45c6-b18a-4cee9f522fb4 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:56.505071 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e3923101-c5cd-45c6-b18a-4cee9f522fb4 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:56.505646 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e3923101-c5cd-45c6-b18a-4cee9f522fb4 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:56.506426 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e3923101-c5cd-45c6-b18a-4cee9f522fb4 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:56.506864 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e3923101-c5cd-45c6-b18a-4cee9f522fb4 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:56.645288 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-e3923101-c5cd-45c6-b18a-4cee9f522fb4 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:56.653521 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-e3923101-c5cd-45c6-b18a-4cee9f522fb4 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:56.655120 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-e3923101-c5cd-45c6-b18a-4cee9f522fb4 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:56.656370 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-e3923101-c5cd-45c6-b18a-4cee9f522fb4 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1752 microversion: 2.20 time: 0.163468 Jun 01 04:31:56.656935 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 241/472] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:56 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:31:57.675738 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-a5becd5c-b0e1-4530-ab52-9dd66192a1e7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:57.676289 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-a5becd5c-b0e1-4530-ab52-9dd66192a1e7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:57.682995 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a5becd5c-b0e1-4530-ab52-9dd66192a1e7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:57.683485 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a5becd5c-b0e1-4530-ab52-9dd66192a1e7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:57.684246 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a5becd5c-b0e1-4530-ab52-9dd66192a1e7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:57.684682 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a5becd5c-b0e1-4530-ab52-9dd66192a1e7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:57.813976 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-a5becd5c-b0e1-4530-ab52-9dd66192a1e7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:57.823287 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-a5becd5c-b0e1-4530-ab52-9dd66192a1e7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:57.824942 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-a5becd5c-b0e1-4530-ab52-9dd66192a1e7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:57.826076 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-a5becd5c-b0e1-4530-ab52-9dd66192a1e7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1754 microversion: 2.20 time: 0.154955 Jun 01 04:31:57.826625 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 232/473] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:57 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:31:58.848820 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-7cb53d05-48dd-4601-a741-a7d99c6bb9be tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:31:58.849806 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-7cb53d05-48dd-4601-a741-a7d99c6bb9be tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:31:58.859368 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7cb53d05-48dd-4601-a741-a7d99c6bb9be tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:58.860004 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7cb53d05-48dd-4601-a741-a7d99c6bb9be tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:58.861135 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7cb53d05-48dd-4601-a741-a7d99c6bb9be tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:31:58.861751 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7cb53d05-48dd-4601-a741-a7d99c6bb9be tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:31:59.002903 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-7cb53d05-48dd-4601-a741-a7d99c6bb9be tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:59.011637 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-7cb53d05-48dd-4601-a741-a7d99c6bb9be tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:59.013169 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-7cb53d05-48dd-4601-a741-a7d99c6bb9be tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:31:59.014318 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-7cb53d05-48dd-4601-a741-a7d99c6bb9be tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.172751 Jun 01 04:31:59.014876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 242/474] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:31:58 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:32:00.032464 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-7115eaaf-9018-4b6a-8826-0650d6aba92c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:00.033164 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-7115eaaf-9018-4b6a-8826-0650d6aba92c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:00.040031 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7115eaaf-9018-4b6a-8826-0650d6aba92c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:00.040480 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7115eaaf-9018-4b6a-8826-0650d6aba92c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:00.041300 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7115eaaf-9018-4b6a-8826-0650d6aba92c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:00.041737 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7115eaaf-9018-4b6a-8826-0650d6aba92c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:00.201907 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-7115eaaf-9018-4b6a-8826-0650d6aba92c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:00.212257 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-7115eaaf-9018-4b6a-8826-0650d6aba92c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:00.214200 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-7115eaaf-9018-4b6a-8826-0650d6aba92c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:00.215384 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-7115eaaf-9018-4b6a-8826-0650d6aba92c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.186883 Jun 01 04:32:00.215938 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 233/475] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:00 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:32:01.234180 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-4539775f-efa5-465d-bf28-c374d1931d1e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:01.234709 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-4539775f-efa5-465d-bf28-c374d1931d1e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:01.240953 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4539775f-efa5-465d-bf28-c374d1931d1e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:01.241398 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4539775f-efa5-465d-bf28-c374d1931d1e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:01.242170 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4539775f-efa5-465d-bf28-c374d1931d1e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:01.242601 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4539775f-efa5-465d-bf28-c374d1931d1e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:01.353843 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-294ab4cd-494c-4a29-b4d9-870370417494 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:01.354404 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-294ab4cd-494c-4a29-b4d9-870370417494 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:01.360973 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-294ab4cd-494c-4a29-b4d9-870370417494 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:01.361429 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-294ab4cd-494c-4a29-b4d9-870370417494 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:01.363008 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-294ab4cd-494c-4a29-b4d9-870370417494 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:01.363549 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-294ab4cd-494c-4a29-b4d9-870370417494 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:01.388168 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-4539775f-efa5-465d-bf28-c374d1931d1e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:01.389361 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-294ab4cd-494c-4a29-b4d9-870370417494 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95/ips" status: 200 len: 145 microversion: 2.1 time: 0.039243 Jun 01 04:32:01.390098 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 234/476] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jun 1 04:32:01 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:32:01.398885 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-4539775f-efa5-465d-bf28-c374d1931d1e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:01.400551 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-4539775f-efa5-465d-bf28-c374d1931d1e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:01.402173 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-4539775f-efa5-465d-bf28-c374d1931d1e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.171944 Jun 01 04:32:01.402909 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 243/477] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:01 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:32:02.420831 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b0480e01-f4ba-45a4-a2dc-0d81c83d822d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:02.421568 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-b0480e01-f4ba-45a4-a2dc-0d81c83d822d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:02.428621 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b0480e01-f4ba-45a4-a2dc-0d81c83d822d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:02.429074 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b0480e01-f4ba-45a4-a2dc-0d81c83d822d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:02.429852 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b0480e01-f4ba-45a4-a2dc-0d81c83d822d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:02.430292 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b0480e01-f4ba-45a4-a2dc-0d81c83d822d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:02.563151 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b0480e01-f4ba-45a4-a2dc-0d81c83d822d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:02.572537 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b0480e01-f4ba-45a4-a2dc-0d81c83d822d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:02.574088 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b0480e01-f4ba-45a4-a2dc-0d81c83d822d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:02.575246 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-b0480e01-f4ba-45a4-a2dc-0d81c83d822d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.158413 Jun 01 04:32:02.575830 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 235/478] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:02 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:32:03.594410 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-ba925752-76d7-4def-829c-c4fdfae337e9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:03.595807 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-ba925752-76d7-4def-829c-c4fdfae337e9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:03.602185 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ba925752-76d7-4def-829c-c4fdfae337e9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:03.602638 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ba925752-76d7-4def-829c-c4fdfae337e9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:03.603446 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ba925752-76d7-4def-829c-c4fdfae337e9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:03.603885 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ba925752-76d7-4def-829c-c4fdfae337e9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:03.746873 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-ba925752-76d7-4def-829c-c4fdfae337e9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:03.756266 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-ba925752-76d7-4def-829c-c4fdfae337e9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:03.757765 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-ba925752-76d7-4def-829c-c4fdfae337e9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:03.758912 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-ba925752-76d7-4def-829c-c4fdfae337e9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.168695 Jun 01 04:32:03.759487 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 244/479] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:03 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:32:04.777148 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-21150a0c-b372-454d-ba8c-fec8c6bddf22 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:04.777784 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-21150a0c-b372-454d-ba8c-fec8c6bddf22 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:04.784429 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-21150a0c-b372-454d-ba8c-fec8c6bddf22 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:04.784862 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-21150a0c-b372-454d-ba8c-fec8c6bddf22 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:04.785788 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-21150a0c-b372-454d-ba8c-fec8c6bddf22 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:04.786249 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-21150a0c-b372-454d-ba8c-fec8c6bddf22 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:04.947190 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-21150a0c-b372-454d-ba8c-fec8c6bddf22 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:04.956872 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-21150a0c-b372-454d-ba8c-fec8c6bddf22 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:04.974453 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-21150a0c-b372-454d-ba8c-fec8c6bddf22 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:04.974453 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-21150a0c-b372-454d-ba8c-fec8c6bddf22 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.186628 Jun 01 04:32:04.974453 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 236/480] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:04 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:32:05.343732 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-9eb9e25e-f2bf-41c9-9942-129786552276 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c562a5c-835a-41f9-bbbf-ecbeb8faad9d"}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:32:05.344824 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-9eb9e25e-f2bf-41c9-9942-129786552276 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:05.351575 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9eb9e25e-f2bf-41c9-9942-129786552276 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:05.352032 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9eb9e25e-f2bf-41c9-9942-129786552276 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:05.352812 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9eb9e25e-f2bf-41c9-9942-129786552276 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:05.353259 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9eb9e25e-f2bf-41c9-9942-129786552276 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:05.978055 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-a2a428f7-d535-4867-a67f-25fccef56be1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:05.983609 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-a2a428f7-d535-4867-a67f-25fccef56be1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:05.985254 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a2a428f7-d535-4867-a67f-25fccef56be1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:05.985703 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a2a428f7-d535-4867-a67f-25fccef56be1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:05.986737 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a2a428f7-d535-4867-a67f-25fccef56be1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:05.988096 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a2a428f7-d535-4867-a67f-25fccef56be1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:06.128890 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-a2a428f7-d535-4867-a67f-25fccef56be1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:06.138035 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-a2a428f7-d535-4867-a67f-25fccef56be1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:06.139496 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-a2a428f7-d535-4867-a67f-25fccef56be1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:06.140705 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-a2a428f7-d535-4867-a67f-25fccef56be1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.166556 Jun 01 04:32:06.152337 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 237/481] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:05 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:32:07.159372 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-37bdd49a-7979-41b1-b148-40b5eca304b0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:07.160078 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-37bdd49a-7979-41b1-b148-40b5eca304b0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:07.166626 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-37bdd49a-7979-41b1-b148-40b5eca304b0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:07.167080 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-37bdd49a-7979-41b1-b148-40b5eca304b0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:07.167972 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-37bdd49a-7979-41b1-b148-40b5eca304b0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:07.168346 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-37bdd49a-7979-41b1-b148-40b5eca304b0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:07.303899 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-37bdd49a-7979-41b1-b148-40b5eca304b0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:07.312363 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-37bdd49a-7979-41b1-b148-40b5eca304b0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:07.313936 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-37bdd49a-7979-41b1-b148-40b5eca304b0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:07.315132 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-37bdd49a-7979-41b1-b148-40b5eca304b0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.160476 Jun 01 04:32:07.315924 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 238/482] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:07 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:32:08.335450 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d6074208-7699-4abc-bddf-026380c98b66 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:08.336161 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-d6074208-7699-4abc-bddf-026380c98b66 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:08.344670 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d6074208-7699-4abc-bddf-026380c98b66 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:08.345841 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d6074208-7699-4abc-bddf-026380c98b66 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:08.347223 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d6074208-7699-4abc-bddf-026380c98b66 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:08.348489 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d6074208-7699-4abc-bddf-026380c98b66 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:08.375066 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:32:08.497614 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-d6074208-7699-4abc-bddf-026380c98b66 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:08.506368 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-d6074208-7699-4abc-bddf-026380c98b66 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:08.508085 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-d6074208-7699-4abc-bddf-026380c98b66 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:08.509350 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-d6074208-7699-4abc-bddf-026380c98b66 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.179722 Jun 01 04:32:08.520753 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 239/483] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:08 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:32:09.529450 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-95af33eb-4751-4b7d-9357-7d3a4f4689b5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:09.529450 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-95af33eb-4751-4b7d-9357-7d3a4f4689b5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:09.537689 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-95af33eb-4751-4b7d-9357-7d3a4f4689b5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:09.538132 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-95af33eb-4751-4b7d-9357-7d3a4f4689b5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:09.538901 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-95af33eb-4751-4b7d-9357-7d3a4f4689b5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:09.539352 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-95af33eb-4751-4b7d-9357-7d3a4f4689b5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:09.683028 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-95af33eb-4751-4b7d-9357-7d3a4f4689b5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:09.692706 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-95af33eb-4751-4b7d-9357-7d3a4f4689b5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:09.694230 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-95af33eb-4751-4b7d-9357-7d3a4f4689b5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:09.695410 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-95af33eb-4751-4b7d-9357-7d3a4f4689b5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.170774 Jun 01 04:32:09.695975 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 240/484] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:09 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:32:10.713121 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-09bdbad5-46b2-4e00-a20a-dc485aec18d2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:10.713817 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-09bdbad5-46b2-4e00-a20a-dc485aec18d2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:10.721960 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-09bdbad5-46b2-4e00-a20a-dc485aec18d2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:10.722471 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-09bdbad5-46b2-4e00-a20a-dc485aec18d2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:10.723425 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-09bdbad5-46b2-4e00-a20a-dc485aec18d2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:10.723956 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-09bdbad5-46b2-4e00-a20a-dc485aec18d2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:10.871770 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-09bdbad5-46b2-4e00-a20a-dc485aec18d2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:10.880646 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-09bdbad5-46b2-4e00-a20a-dc485aec18d2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:10.882224 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-09bdbad5-46b2-4e00-a20a-dc485aec18d2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:10.883403 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-09bdbad5-46b2-4e00-a20a-dc485aec18d2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.174325 Jun 01 04:32:10.883961 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 241/485] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:10 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:32:11.902159 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-11410028-5d25-4bbd-a3c6-e191f8ca702e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:11.902837 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-11410028-5d25-4bbd-a3c6-e191f8ca702e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:11.909296 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-11410028-5d25-4bbd-a3c6-e191f8ca702e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:11.909743 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-11410028-5d25-4bbd-a3c6-e191f8ca702e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:11.910507 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-11410028-5d25-4bbd-a3c6-e191f8ca702e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:11.910943 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-11410028-5d25-4bbd-a3c6-e191f8ca702e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:12.048057 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-11410028-5d25-4bbd-a3c6-e191f8ca702e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:12.059396 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-11410028-5d25-4bbd-a3c6-e191f8ca702e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:12.061578 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-11410028-5d25-4bbd-a3c6-e191f8ca702e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:12.062744 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-11410028-5d25-4bbd-a3c6-e191f8ca702e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.164626 Jun 01 04:32:12.063333 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 242/486] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:11 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:32:13.082680 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-664e16c8-95ee-4fdd-8e4f-d80ed391fb0d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:13.083437 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-664e16c8-95ee-4fdd-8e4f-d80ed391fb0d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:13.089851 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-664e16c8-95ee-4fdd-8e4f-d80ed391fb0d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:13.090297 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-664e16c8-95ee-4fdd-8e4f-d80ed391fb0d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:13.091086 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-664e16c8-95ee-4fdd-8e4f-d80ed391fb0d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:13.091617 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-664e16c8-95ee-4fdd-8e4f-d80ed391fb0d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:13.239968 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-664e16c8-95ee-4fdd-8e4f-d80ed391fb0d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:13.249109 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-664e16c8-95ee-4fdd-8e4f-d80ed391fb0d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:13.250621 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-664e16c8-95ee-4fdd-8e4f-d80ed391fb0d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:13.253356 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-664e16c8-95ee-4fdd-8e4f-d80ed391fb0d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.173741 Jun 01 04:32:13.253356 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 243/487] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:13 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:32:14.274281 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-70e84cca-26dc-481f-a4d3-1272bc818945 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:14.274978 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-70e84cca-26dc-481f-a4d3-1272bc818945 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:14.277476 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_api:SELECT=50 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:32:14.282215 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-70e84cca-26dc-481f-a4d3-1272bc818945 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:14.288075 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-70e84cca-26dc-481f-a4d3-1272bc818945 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:14.288075 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-70e84cca-26dc-481f-a4d3-1272bc818945 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:14.288075 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-70e84cca-26dc-481f-a4d3-1272bc818945 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:14.417668 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-70e84cca-26dc-481f-a4d3-1272bc818945 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:14.426228 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-70e84cca-26dc-481f-a4d3-1272bc818945 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:14.431242 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-70e84cca-26dc-481f-a4d3-1272bc818945 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:14.431242 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-70e84cca-26dc-481f-a4d3-1272bc818945 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.158670 Jun 01 04:32:14.431242 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 244/488] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:14 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:32:15.349101 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_api:SELECT=39 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:32:15.438385 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:32:15.447127 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-9346c945-da22-429b-bd01-cf0c0e13c86f tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:15.447756 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-9346c945-da22-429b-bd01-cf0c0e13c86f tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:15.454300 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9346c945-da22-429b-bd01-cf0c0e13c86f tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:15.454744 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9346c945-da22-429b-bd01-cf0c0e13c86f tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:15.455529 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9346c945-da22-429b-bd01-cf0c0e13c86f tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:15.456560 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9346c945-da22-429b-bd01-cf0c0e13c86f tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:15.584268 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-9346c945-da22-429b-bd01-cf0c0e13c86f tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:15.592742 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-9346c945-da22-429b-bd01-cf0c0e13c86f tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:15.594245 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-9346c945-da22-429b-bd01-cf0c0e13c86f tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:15.595438 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-9346c945-da22-429b-bd01-cf0c0e13c86f tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.152114 Jun 01 04:32:15.595985 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 245/489] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:15 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:32:16.613311 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-dc35fd64-5365-4ee3-bbf7-d0df9a40f6b5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:16.613976 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-dc35fd64-5365-4ee3-bbf7-d0df9a40f6b5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:16.620900 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-dc35fd64-5365-4ee3-bbf7-d0df9a40f6b5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:16.621357 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-dc35fd64-5365-4ee3-bbf7-d0df9a40f6b5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:16.622133 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-dc35fd64-5365-4ee3-bbf7-d0df9a40f6b5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:16.622763 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-dc35fd64-5365-4ee3-bbf7-d0df9a40f6b5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:16.757950 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-dc35fd64-5365-4ee3-bbf7-d0df9a40f6b5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:16.766435 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-dc35fd64-5365-4ee3-bbf7-d0df9a40f6b5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:16.768038 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-dc35fd64-5365-4ee3-bbf7-d0df9a40f6b5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:16.769205 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-dc35fd64-5365-4ee3-bbf7-d0df9a40f6b5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.160214 Jun 01 04:32:16.770391 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 246/490] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:16 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:32:17.788666 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-3b927e6e-e8c0-4510-a4d4-8b7f8b59f069 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:17.789308 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-3b927e6e-e8c0-4510-a4d4-8b7f8b59f069 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:17.796038 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3b927e6e-e8c0-4510-a4d4-8b7f8b59f069 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:17.796484 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3b927e6e-e8c0-4510-a4d4-8b7f8b59f069 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:17.797256 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3b927e6e-e8c0-4510-a4d4-8b7f8b59f069 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:17.797688 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3b927e6e-e8c0-4510-a4d4-8b7f8b59f069 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:17.931574 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-3b927e6e-e8c0-4510-a4d4-8b7f8b59f069 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:17.940591 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-3b927e6e-e8c0-4510-a4d4-8b7f8b59f069 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:17.942712 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-3b927e6e-e8c0-4510-a4d4-8b7f8b59f069 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:17.943885 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-3b927e6e-e8c0-4510-a4d4-8b7f8b59f069 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.159230 Jun 01 04:32:17.944440 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 247/491] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:17 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:32:18.572790 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-541fb98e-f310-4094-bd91-a72476d047f4 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f70887c-e824-4f92-bbb4-6d446c567dfe", "device": "/dev/sdb"}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:32:18.574462 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-541fb98e-f310-4094-bd91-a72476d047f4 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: ee6bbca6-d73f-46d5-a3b9-684c864dbdaf] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:18.580508 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-541fb98e-f310-4094-bd91-a72476d047f4 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:18.591390 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-541fb98e-f310-4094-bd91-a72476d047f4 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:18.591390 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-541fb98e-f310-4094-bd91-a72476d047f4 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:18.591390 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-541fb98e-f310-4094-bd91-a72476d047f4 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:22.128044 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-541fb98e-f310-4094-bd91-a72476d047f4 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "POST /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.558777 Jun 01 04:32:22.128774 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 248/492] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 1 04:32:18 2022] POST /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf/os-volume_attachments => generated 194 bytes in 3560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:32:22.134838 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-f1c41a9d-f3aa-4a45-9df9-206546233801 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:22.135689 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-f1c41a9d-f3aa-4a45-9df9-206546233801 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:22.141916 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f1c41a9d-f3aa-4a45-9df9-206546233801 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:22.142376 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f1c41a9d-f3aa-4a45-9df9-206546233801 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:22.143134 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f1c41a9d-f3aa-4a45-9df9-206546233801 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:22.143591 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f1c41a9d-f3aa-4a45-9df9-206546233801 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:22.156642 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-9eb9e25e-f2bf-41c9-9942-129786552276 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "POST /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 16.816724 Jun 01 04:32:22.165649 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 245/493] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 1 04:32:05 2022] POST /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95/os-volume_attachments => generated 194 bytes in 16819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:32:22.289977 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-f1c41a9d-f3aa-4a45-9df9-206546233801 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:22.299757 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-f1c41a9d-f3aa-4a45-9df9-206546233801 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:22.301995 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-f1c41a9d-f3aa-4a45-9df9-206546233801 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:22.303524 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-f1c41a9d-f3aa-4a45-9df9-206546233801 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.173309 Jun 01 04:32:22.304070 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 249/494] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:22 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:32:23.323091 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-ff906b38-0282-4b6c-8a2b-64dddcb05957 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:23.323753 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-ff906b38-0282-4b6c-8a2b-64dddcb05957 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:23.329855 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ff906b38-0282-4b6c-8a2b-64dddcb05957 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:23.330297 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ff906b38-0282-4b6c-8a2b-64dddcb05957 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:23.331055 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ff906b38-0282-4b6c-8a2b-64dddcb05957 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:23.331520 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ff906b38-0282-4b6c-8a2b-64dddcb05957 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:23.465141 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-ff906b38-0282-4b6c-8a2b-64dddcb05957 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:23.473637 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-ff906b38-0282-4b6c-8a2b-64dddcb05957 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:23.475139 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-ff906b38-0282-4b6c-8a2b-64dddcb05957 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:23.476315 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-ff906b38-0282-4b6c-8a2b-64dddcb05957 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.158463 Jun 01 04:32:23.476858 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 246/495] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:23 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:32:24.494231 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-f2cf420d-f3a5-42df-89fb-4cd824a534d9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:24.494940 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-f2cf420d-f3a5-42df-89fb-4cd824a534d9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:24.501444 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f2cf420d-f3a5-42df-89fb-4cd824a534d9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:24.501922 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f2cf420d-f3a5-42df-89fb-4cd824a534d9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:24.502687 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f2cf420d-f3a5-42df-89fb-4cd824a534d9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:24.503128 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f2cf420d-f3a5-42df-89fb-4cd824a534d9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:24.634001 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-f2cf420d-f3a5-42df-89fb-4cd824a534d9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:24.642404 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-f2cf420d-f3a5-42df-89fb-4cd824a534d9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:24.643947 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-f2cf420d-f3a5-42df-89fb-4cd824a534d9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:24.645100 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-f2cf420d-f3a5-42df-89fb-4cd824a534d9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.154834 Jun 01 04:32:24.645655 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 250/496] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:24 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:32:25.663660 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-8dd568d7-d755-462a-9f79-7ec73612e4c1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:25.664301 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-8dd568d7-d755-462a-9f79-7ec73612e4c1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:25.672121 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8dd568d7-d755-462a-9f79-7ec73612e4c1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:25.672580 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8dd568d7-d755-462a-9f79-7ec73612e4c1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:25.673354 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8dd568d7-d755-462a-9f79-7ec73612e4c1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:25.673786 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8dd568d7-d755-462a-9f79-7ec73612e4c1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:25.804480 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-8dd568d7-d755-462a-9f79-7ec73612e4c1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:25.812866 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-8dd568d7-d755-462a-9f79-7ec73612e4c1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:25.814368 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-8dd568d7-d755-462a-9f79-7ec73612e4c1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:25.815540 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-8dd568d7-d755-462a-9f79-7ec73612e4c1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.155809 Jun 01 04:32:25.816084 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 247/497] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:25 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:32:26.834107 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-0c49c6c9-0692-4beb-b2d8-803c3d7f799a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:26.834704 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-0c49c6c9-0692-4beb-b2d8-803c3d7f799a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:26.841940 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0c49c6c9-0692-4beb-b2d8-803c3d7f799a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:26.842384 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0c49c6c9-0692-4beb-b2d8-803c3d7f799a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:26.843137 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0c49c6c9-0692-4beb-b2d8-803c3d7f799a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:26.843606 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0c49c6c9-0692-4beb-b2d8-803c3d7f799a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:26.974401 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-0c49c6c9-0692-4beb-b2d8-803c3d7f799a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:26.982861 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-0c49c6c9-0692-4beb-b2d8-803c3d7f799a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:26.984457 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-0c49c6c9-0692-4beb-b2d8-803c3d7f799a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:26.985603 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-0c49c6c9-0692-4beb-b2d8-803c3d7f799a tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.155468 Jun 01 04:32:26.986176 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 251/498] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:26 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:32:28.003914 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-c92a9d5d-e63e-4e36-90f3-9af963c10508 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:28.004522 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-c92a9d5d-e63e-4e36-90f3-9af963c10508 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:28.011149 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c92a9d5d-e63e-4e36-90f3-9af963c10508 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:28.011639 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c92a9d5d-e63e-4e36-90f3-9af963c10508 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:28.012454 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c92a9d5d-e63e-4e36-90f3-9af963c10508 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:28.012903 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c92a9d5d-e63e-4e36-90f3-9af963c10508 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:28.144152 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-c92a9d5d-e63e-4e36-90f3-9af963c10508 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:28.153496 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-c92a9d5d-e63e-4e36-90f3-9af963c10508 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:28.154958 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-c92a9d5d-e63e-4e36-90f3-9af963c10508 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:28.156263 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-c92a9d5d-e63e-4e36-90f3-9af963c10508 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.156330 Jun 01 04:32:28.156812 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 248/499] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:27 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:32:29.175173 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-1a3df5fa-4c2e-46dc-bb8f-368dc0624be2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:29.175832 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-1a3df5fa-4c2e-46dc-bb8f-368dc0624be2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:29.183130 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1a3df5fa-4c2e-46dc-bb8f-368dc0624be2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:29.183618 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1a3df5fa-4c2e-46dc-bb8f-368dc0624be2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:29.184441 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1a3df5fa-4c2e-46dc-bb8f-368dc0624be2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:29.184903 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1a3df5fa-4c2e-46dc-bb8f-368dc0624be2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:29.363645 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-1a3df5fa-4c2e-46dc-bb8f-368dc0624be2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:29.372674 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-1a3df5fa-4c2e-46dc-bb8f-368dc0624be2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:29.374185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-1a3df5fa-4c2e-46dc-bb8f-368dc0624be2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:29.375353 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-1a3df5fa-4c2e-46dc-bb8f-368dc0624be2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.204175 Jun 01 04:32:29.375908 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 252/500] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:29 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:32:30.138185 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-112cfcb4-4399-484e-b367-f3bd140386c6 req-0d277dde-c893-4f6e-9105-f1fee101d679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c961e06b-1b03-4e97-8487-57adba5d5e16", "name": "network-vif-plugged", "status": "completed", "tag": "690b8ab1-955e-471f-b256-fa4681ea0480"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:32:30.147098 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-112cfcb4-4399-484e-b367-f3bd140386c6 req-0d277dde-c893-4f6e-9105-f1fee101d679 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:30.147561 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-112cfcb4-4399-484e-b367-f3bd140386c6 req-0d277dde-c893-4f6e-9105-f1fee101d679 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:30.158661 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-112cfcb4-4399-484e-b367-f3bd140386c6 req-0d277dde-c893-4f6e-9105-f1fee101d679 service nova] Creating event network-vif-plugged:690b8ab1-955e-471f-b256-fa4681ea0480 for instance c961e06b-1b03-4e97-8487-57adba5d5e16 on hv-cinder-66710 Jun 01 04:32:30.163728 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-112cfcb4-4399-484e-b367-f3bd140386c6 req-0d277dde-c893-4f6e-9105-f1fee101d679 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030036 Jun 01 04:32:30.164489 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 249/501] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:32:30.393391 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-21bbeddd-01de-418f-84b6-e4459b394a2b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:30.393985 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-21bbeddd-01de-418f-84b6-e4459b394a2b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:30.400442 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-21bbeddd-01de-418f-84b6-e4459b394a2b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:30.401802 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-21bbeddd-01de-418f-84b6-e4459b394a2b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:30.401802 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-21bbeddd-01de-418f-84b6-e4459b394a2b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:30.402068 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-21bbeddd-01de-418f-84b6-e4459b394a2b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:30.533483 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-21bbeddd-01de-418f-84b6-e4459b394a2b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:30.542335 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-21bbeddd-01de-418f-84b6-e4459b394a2b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:30.543873 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-21bbeddd-01de-418f-84b6-e4459b394a2b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:30.545019 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-21bbeddd-01de-418f-84b6-e4459b394a2b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.155686 Jun 01 04:32:30.545571 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 253/502] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:30 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:32:31.564452 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-aec9c342-ff2b-4cea-ba46-40d013e0d0ef tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:31.565106 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-aec9c342-ff2b-4cea-ba46-40d013e0d0ef tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:31.572130 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-aec9c342-ff2b-4cea-ba46-40d013e0d0ef tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:31.572578 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-aec9c342-ff2b-4cea-ba46-40d013e0d0ef tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:31.573341 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-aec9c342-ff2b-4cea-ba46-40d013e0d0ef tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:31.573770 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-aec9c342-ff2b-4cea-ba46-40d013e0d0ef tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:31.758783 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-aec9c342-ff2b-4cea-ba46-40d013e0d0ef tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:31.767188 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-aec9c342-ff2b-4cea-ba46-40d013e0d0ef tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:31.768727 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-aec9c342-ff2b-4cea-ba46-40d013e0d0ef tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:31.769878 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-aec9c342-ff2b-4cea-ba46-40d013e0d0ef tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.209773 Jun 01 04:32:31.770424 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 250/503] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:31 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:32:32.788280 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-fa203e3f-2dd2-45b8-9dc0-a95d32851003 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:32.788880 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-fa203e3f-2dd2-45b8-9dc0-a95d32851003 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:32.795472 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fa203e3f-2dd2-45b8-9dc0-a95d32851003 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:32.795929 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fa203e3f-2dd2-45b8-9dc0-a95d32851003 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:32.796690 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fa203e3f-2dd2-45b8-9dc0-a95d32851003 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:32.797124 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fa203e3f-2dd2-45b8-9dc0-a95d32851003 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:32.925192 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-fa203e3f-2dd2-45b8-9dc0-a95d32851003 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:32.928853 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:32:32.934050 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-fa203e3f-2dd2-45b8-9dc0-a95d32851003 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:32.939433 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-fa203e3f-2dd2-45b8-9dc0-a95d32851003 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:32.939433 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-fa203e3f-2dd2-45b8-9dc0-a95d32851003 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.152331 Jun 01 04:32:32.939433 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 254/504] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:32 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:32:33.955328 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-6a85c723-5868-4240-aad5-f4811ef991c2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:33.955886 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-6a85c723-5868-4240-aad5-f4811ef991c2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:33.963022 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6a85c723-5868-4240-aad5-f4811ef991c2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:33.969655 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6a85c723-5868-4240-aad5-f4811ef991c2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:33.969655 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6a85c723-5868-4240-aad5-f4811ef991c2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:33.969655 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6a85c723-5868-4240-aad5-f4811ef991c2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:34.096352 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-6a85c723-5868-4240-aad5-f4811ef991c2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:34.105374 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-6a85c723-5868-4240-aad5-f4811ef991c2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:34.106860 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-6a85c723-5868-4240-aad5-f4811ef991c2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:34.108020 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-6a85c723-5868-4240-aad5-f4811ef991c2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.156715 Jun 01 04:32:34.108568 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 251/505] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:33 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:32:35.126077 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d1e1ee28-8c7e-4451-8ce5-cfcb911a2408 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:35.126610 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-d1e1ee28-8c7e-4451-8ce5-cfcb911a2408 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:35.134147 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d1e1ee28-8c7e-4451-8ce5-cfcb911a2408 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:35.134588 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d1e1ee28-8c7e-4451-8ce5-cfcb911a2408 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:35.135364 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d1e1ee28-8c7e-4451-8ce5-cfcb911a2408 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:35.135795 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d1e1ee28-8c7e-4451-8ce5-cfcb911a2408 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:35.270980 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-d1e1ee28-8c7e-4451-8ce5-cfcb911a2408 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:35.280295 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-d1e1ee28-8c7e-4451-8ce5-cfcb911a2408 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:35.281804 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-d1e1ee28-8c7e-4451-8ce5-cfcb911a2408 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:35.282946 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-d1e1ee28-8c7e-4451-8ce5-cfcb911a2408 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.160829 Jun 01 04:32:35.283514 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 255/506] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:35 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:32:36.301187 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-fc528acf-7eee-4e20-9f03-7af641bc684d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:36.301810 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-fc528acf-7eee-4e20-9f03-7af641bc684d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:36.308051 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-fc528acf-7eee-4e20-9f03-7af641bc684d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:36.308490 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-fc528acf-7eee-4e20-9f03-7af641bc684d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:36.309242 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-fc528acf-7eee-4e20-9f03-7af641bc684d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:36.309669 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-fc528acf-7eee-4e20-9f03-7af641bc684d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:36.442386 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-fc528acf-7eee-4e20-9f03-7af641bc684d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:36.453573 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-fc528acf-7eee-4e20-9f03-7af641bc684d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:36.455083 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-fc528acf-7eee-4e20-9f03-7af641bc684d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:36.456293 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-fc528acf-7eee-4e20-9f03-7af641bc684d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.159138 Jun 01 04:32:36.456849 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 252/507] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:36 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:32:37.474568 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b61aa3b1-728c-479f-a167-5e1ec9607133 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:37.475168 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-b61aa3b1-728c-479f-a167-5e1ec9607133 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:37.482413 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b61aa3b1-728c-479f-a167-5e1ec9607133 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:37.482858 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b61aa3b1-728c-479f-a167-5e1ec9607133 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:37.483685 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b61aa3b1-728c-479f-a167-5e1ec9607133 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:37.484120 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b61aa3b1-728c-479f-a167-5e1ec9607133 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:37.635383 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b61aa3b1-728c-479f-a167-5e1ec9607133 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:37.644410 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b61aa3b1-728c-479f-a167-5e1ec9607133 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:37.645932 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b61aa3b1-728c-479f-a167-5e1ec9607133 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:37.647783 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-b61aa3b1-728c-479f-a167-5e1ec9607133 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.176482 Jun 01 04:32:37.648692 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 256/508] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:37 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:32:38.581550 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 01 04:32:38.582233 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Wed Jun 1 04:32:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 01 04:32:38.771491 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-421d8011-e594-4440-9e1e-26f62031cd46 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:38.772285 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-421d8011-e594-4440-9e1e-26f62031cd46 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:38.778592 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-421d8011-e594-4440-9e1e-26f62031cd46 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:38.779108 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-421d8011-e594-4440-9e1e-26f62031cd46 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:38.783501 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-421d8011-e594-4440-9e1e-26f62031cd46 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:38.783501 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-421d8011-e594-4440-9e1e-26f62031cd46 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:38.915773 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-421d8011-e594-4440-9e1e-26f62031cd46 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:38.924253 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-421d8011-e594-4440-9e1e-26f62031cd46 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:38.925686 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-421d8011-e594-4440-9e1e-26f62031cd46 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:38.926802 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-421d8011-e594-4440-9e1e-26f62031cd46 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.265132 Jun 01 04:32:38.927347 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 253/509] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:38 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:32:39.946127 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-c5bda3b9-7436-40ec-83b4-c08d68b1f474 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:39.946733 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-c5bda3b9-7436-40ec-83b4-c08d68b1f474 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:39.953244 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c5bda3b9-7436-40ec-83b4-c08d68b1f474 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:39.953697 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c5bda3b9-7436-40ec-83b4-c08d68b1f474 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:39.954455 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c5bda3b9-7436-40ec-83b4-c08d68b1f474 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:39.954893 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c5bda3b9-7436-40ec-83b4-c08d68b1f474 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:40.081991 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-c5bda3b9-7436-40ec-83b4-c08d68b1f474 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:40.091159 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-c5bda3b9-7436-40ec-83b4-c08d68b1f474 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:40.092699 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-c5bda3b9-7436-40ec-83b4-c08d68b1f474 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:40.093858 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-c5bda3b9-7436-40ec-83b4-c08d68b1f474 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.152221 Jun 01 04:32:40.094403 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 257/510] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:39 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:32:41.111566 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-f3ae1bd8-38d3-4918-a3fb-63cd2de40c73 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:41.112405 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-f3ae1bd8-38d3-4918-a3fb-63cd2de40c73 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:41.119558 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f3ae1bd8-38d3-4918-a3fb-63cd2de40c73 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:41.120005 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f3ae1bd8-38d3-4918-a3fb-63cd2de40c73 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:41.120766 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f3ae1bd8-38d3-4918-a3fb-63cd2de40c73 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:41.121201 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f3ae1bd8-38d3-4918-a3fb-63cd2de40c73 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:41.249536 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-f3ae1bd8-38d3-4918-a3fb-63cd2de40c73 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:41.258100 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-f3ae1bd8-38d3-4918-a3fb-63cd2de40c73 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:41.259832 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-f3ae1bd8-38d3-4918-a3fb-63cd2de40c73 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:41.260971 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-f3ae1bd8-38d3-4918-a3fb-63cd2de40c73 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.153304 Jun 01 04:32:41.261519 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 254/511] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:41 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:32:42.277993 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-2edf526b-8bb2-4b97-b435-59e2aa7671d7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:42.278602 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-2edf526b-8bb2-4b97-b435-59e2aa7671d7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:42.285066 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2edf526b-8bb2-4b97-b435-59e2aa7671d7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:42.285521 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2edf526b-8bb2-4b97-b435-59e2aa7671d7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:42.286298 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2edf526b-8bb2-4b97-b435-59e2aa7671d7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:42.286734 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2edf526b-8bb2-4b97-b435-59e2aa7671d7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:42.418188 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-2edf526b-8bb2-4b97-b435-59e2aa7671d7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:42.426611 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-2edf526b-8bb2-4b97-b435-59e2aa7671d7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:42.428170 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-2edf526b-8bb2-4b97-b435-59e2aa7671d7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:42.429838 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-2edf526b-8bb2-4b97-b435-59e2aa7671d7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1810 microversion: 2.20 time: 0.155231 Jun 01 04:32:42.430390 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 258/512] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:42 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:32:43.422011 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-2dbf9d01-c3a2-4bf5-939c-445fbf0efee7 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:32:43.428612 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2dbf9d01-c3a2-4bf5-939c-445fbf0efee7 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:43.429055 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2dbf9d01-c3a2-4bf5-939c-445fbf0efee7 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:43.447517 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-ece77714-9ca5-4b7f-a35a-5f7591fef956 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:43.448214 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-ece77714-9ca5-4b7f-a35a-5f7591fef956 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:43.454796 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ece77714-9ca5-4b7f-a35a-5f7591fef956 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:43.455372 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ece77714-9ca5-4b7f-a35a-5f7591fef956 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:43.456206 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ece77714-9ca5-4b7f-a35a-5f7591fef956 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:43.456739 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ece77714-9ca5-4b7f-a35a-5f7591fef956 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:43.489087 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-2dbf9d01-c3a2-4bf5-939c-445fbf0efee7 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Going to try to stop instance {{(pid=118517) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 01 04:32:43.596504 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-ece77714-9ca5-4b7f-a35a-5f7591fef956 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:43.606325 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-ece77714-9ca5-4b7f-a35a-5f7591fef956 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:43.607926 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-ece77714-9ca5-4b7f-a35a-5f7591fef956 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:43.609075 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-ece77714-9ca5-4b7f-a35a-5f7591fef956 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1797 microversion: 2.20 time: 0.165530 Jun 01 04:32:43.609627 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 259/513] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:32:43 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1797 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:32:43.698035 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-2dbf9d01-c3a2-4bf5-939c-445fbf0efee7 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "POST /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95/action" status: 202 len: 0 microversion: 2.1 time: 0.279644 Jun 01 04:32:43.698715 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 255/514] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 1 04:32:43 2022] POST /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 01 04:32:43.706853 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-790a7285-e48a-4410-828c-9dc3362f912e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:43.707510 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-790a7285-e48a-4410-828c-9dc3362f912e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:43.714112 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-790a7285-e48a-4410-828c-9dc3362f912e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:43.714559 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-790a7285-e48a-4410-828c-9dc3362f912e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:43.715364 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-790a7285-e48a-4410-828c-9dc3362f912e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:43.715780 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-790a7285-e48a-4410-828c-9dc3362f912e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:43.876743 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-790a7285-e48a-4410-828c-9dc3362f912e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:43.884975 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-790a7285-e48a-4410-828c-9dc3362f912e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1721 microversion: 2.1 time: 0.182075 Jun 01 04:32:43.894862 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 260/515] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:32:43 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:32:44.585919 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a681be36-ec96-45b8-b6aa-f2d25212eadc tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf7c57d1-aa77-44dc-a43c-c9f656433a61"}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:32:44.587132 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-a681be36-ec96-45b8-b6aa-f2d25212eadc tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:44.593301 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a681be36-ec96-45b8-b6aa-f2d25212eadc tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:44.593743 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a681be36-ec96-45b8-b6aa-f2d25212eadc tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:44.594508 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a681be36-ec96-45b8-b6aa-f2d25212eadc tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:44.594941 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a681be36-ec96-45b8-b6aa-f2d25212eadc tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:44.902019 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-22220522-293e-45fa-b929-5325b308ed47 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:44.902557 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-22220522-293e-45fa-b929-5325b308ed47 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:44.904876 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_api:SELECT=34 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:32:44.909593 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-22220522-293e-45fa-b929-5325b308ed47 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:44.910036 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-22220522-293e-45fa-b929-5325b308ed47 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:44.910792 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-22220522-293e-45fa-b929-5325b308ed47 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:44.911221 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-22220522-293e-45fa-b929-5325b308ed47 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:45.042732 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-22220522-293e-45fa-b929-5325b308ed47 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:45.050957 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-22220522-293e-45fa-b929-5325b308ed47 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1721 microversion: 2.1 time: 0.152863 Jun 01 04:32:45.051568 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 261/516] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:32:44 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:32:45.401814 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-a681be36-ec96-45b8-b6aa-f2d25212eadc tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "POST /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.923635 Jun 01 04:32:45.402482 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 256/517] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 1 04:32:44 2022] POST /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0/os-volume_attachments => generated 194 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:32:46.069115 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b7c9ca6b-6500-451a-ba8a-622519eb9d9a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:46.069928 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-b7c9ca6b-6500-451a-ba8a-622519eb9d9a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:46.076361 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b7c9ca6b-6500-451a-ba8a-622519eb9d9a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:46.076820 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b7c9ca6b-6500-451a-ba8a-622519eb9d9a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:46.077593 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b7c9ca6b-6500-451a-ba8a-622519eb9d9a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:46.078035 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b7c9ca6b-6500-451a-ba8a-622519eb9d9a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:46.212293 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b7c9ca6b-6500-451a-ba8a-622519eb9d9a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:46.220368 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-b7c9ca6b-6500-451a-ba8a-622519eb9d9a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1721 microversion: 2.1 time: 0.155131 Jun 01 04:32:46.220923 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 262/518] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:32:46 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:32:47.238893 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-1788030b-c352-4f49-af08-e7612cd40422 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:47.239638 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-1788030b-c352-4f49-af08-e7612cd40422 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:47.241574 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_api:SELECT=23 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:32:47.247162 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1788030b-c352-4f49-af08-e7612cd40422 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:47.247637 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1788030b-c352-4f49-af08-e7612cd40422 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:47.248396 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1788030b-c352-4f49-af08-e7612cd40422 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:47.248827 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1788030b-c352-4f49-af08-e7612cd40422 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:47.252954 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:32:47.383892 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-1788030b-c352-4f49-af08-e7612cd40422 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:47.391893 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-1788030b-c352-4f49-af08-e7612cd40422 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1721 microversion: 2.1 time: 0.157996 Jun 01 04:32:47.392451 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 257/519] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:32:47 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:32:48.410024 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-48495387-a8ad-4960-ab2b-e3d3f02d87d3 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:48.410839 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-48495387-a8ad-4960-ab2b-e3d3f02d87d3 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:48.417595 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-48495387-a8ad-4960-ab2b-e3d3f02d87d3 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:48.418044 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-48495387-a8ad-4960-ab2b-e3d3f02d87d3 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:48.418800 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-48495387-a8ad-4960-ab2b-e3d3f02d87d3 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:48.419228 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-48495387-a8ad-4960-ab2b-e3d3f02d87d3 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:48.547189 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-48495387-a8ad-4960-ab2b-e3d3f02d87d3 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:48.556151 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-48495387-a8ad-4960-ab2b-e3d3f02d87d3 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1721 microversion: 2.1 time: 0.149878 Jun 01 04:32:48.556535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 263/520] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:32:48 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:32:49.573855 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-4471bc68-4efc-4189-8ad3-3a334cba23da tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:49.574394 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-4471bc68-4efc-4189-8ad3-3a334cba23da tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:49.581424 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4471bc68-4efc-4189-8ad3-3a334cba23da tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:49.581884 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4471bc68-4efc-4189-8ad3-3a334cba23da tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:49.582645 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4471bc68-4efc-4189-8ad3-3a334cba23da tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:49.583215 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4471bc68-4efc-4189-8ad3-3a334cba23da tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:49.721022 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-4471bc68-4efc-4189-8ad3-3a334cba23da tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:49.729374 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-4471bc68-4efc-4189-8ad3-3a334cba23da tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1721 microversion: 2.1 time: 0.160157 Jun 01 04:32:49.729933 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 258/521] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:32:49 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:32:50.746879 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-e4edb148-9b8f-4353-b64a-ab90f5f1998d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:50.747524 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-e4edb148-9b8f-4353-b64a-ab90f5f1998d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:50.754036 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e4edb148-9b8f-4353-b64a-ab90f5f1998d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:50.754489 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e4edb148-9b8f-4353-b64a-ab90f5f1998d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:50.755259 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e4edb148-9b8f-4353-b64a-ab90f5f1998d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:50.755727 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e4edb148-9b8f-4353-b64a-ab90f5f1998d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:50.890516 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-e4edb148-9b8f-4353-b64a-ab90f5f1998d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:50.899180 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-e4edb148-9b8f-4353-b64a-ab90f5f1998d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1721 microversion: 2.1 time: 0.155492 Jun 01 04:32:50.899784 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 264/522] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:32:50 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:32:51.917832 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-12cc1e68-200b-4b1a-971e-d97fa32829a6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:51.918583 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-12cc1e68-200b-4b1a-971e-d97fa32829a6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:51.925191 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-12cc1e68-200b-4b1a-971e-d97fa32829a6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:51.925736 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-12cc1e68-200b-4b1a-971e-d97fa32829a6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:51.926617 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-12cc1e68-200b-4b1a-971e-d97fa32829a6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:51.927044 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-12cc1e68-200b-4b1a-971e-d97fa32829a6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:52.066300 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-12cc1e68-200b-4b1a-971e-d97fa32829a6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:52.074519 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-12cc1e68-200b-4b1a-971e-d97fa32829a6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1721 microversion: 2.1 time: 0.161328 Jun 01 04:32:52.075115 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 259/523] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:32:51 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:32:53.091858 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-ec8195e1-623f-4d1a-ad85-abeb11c0f35f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:53.092492 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-ec8195e1-623f-4d1a-ad85-abeb11c0f35f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:53.099579 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ec8195e1-623f-4d1a-ad85-abeb11c0f35f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:53.100034 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ec8195e1-623f-4d1a-ad85-abeb11c0f35f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:53.100856 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ec8195e1-623f-4d1a-ad85-abeb11c0f35f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:53.101293 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ec8195e1-623f-4d1a-ad85-abeb11c0f35f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:53.235504 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-ec8195e1-623f-4d1a-ad85-abeb11c0f35f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:53.244658 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-ec8195e1-623f-4d1a-ad85-abeb11c0f35f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1721 microversion: 2.1 time: 0.156705 Jun 01 04:32:53.245233 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 265/524] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:32:53 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:32:54.222070 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-8414c954-70b9-4257-bc55-44a9d4531375 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:54.222564 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-8414c954-70b9-4257-bc55-44a9d4531375 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: ee6bbca6-d73f-46d5-a3b9-684c864dbdaf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:54.229476 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8414c954-70b9-4257-bc55-44a9d4531375 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:54.229707 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8414c954-70b9-4257-bc55-44a9d4531375 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:54.230445 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8414c954-70b9-4257-bc55-44a9d4531375 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:54.230879 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8414c954-70b9-4257-bc55-44a9d4531375 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:54.262601 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-cd9a62ba-6e05-4f3b-86e3-1da84e8f706e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:54.263313 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-cd9a62ba-6e05-4f3b-86e3-1da84e8f706e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:54.269875 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cd9a62ba-6e05-4f3b-86e3-1da84e8f706e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:54.270399 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cd9a62ba-6e05-4f3b-86e3-1da84e8f706e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:54.271221 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cd9a62ba-6e05-4f3b-86e3-1da84e8f706e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:54.271750 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cd9a62ba-6e05-4f3b-86e3-1da84e8f706e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:54.363787 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.objects.instance [None req-8414c954-70b9-4257-bc55-44a9d4531375 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lazy-loading 'services' on Instance uuid ee6bbca6-d73f-46d5-a3b9-684c864dbdaf {{(pid=118517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:32:54.405353 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-cd9a62ba-6e05-4f3b-86e3-1da84e8f706e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:54.413391 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-cd9a62ba-6e05-4f3b-86e3-1da84e8f706e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1721 microversion: 2.1 time: 0.155577 Jun 01 04:32:54.423171 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 266/525] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:32:54 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:32:54.663165 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-8414c954-70b9-4257-bc55-44a9d4531375 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf/os-volume_attachments/2f70887c-e824-4f92-bbb4-6d446c567dfe" status: 202 len: 0 microversion: 2.1 time: 0.444871 Jun 01 04:32:54.664507 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 260/526] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 1 04:32:54 2022] DELETE /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf/os-volume_attachments/2f70887c-e824-4f92-bbb4-6d446c567dfe => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 01 04:32:55.431059 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-077f3a7c-1126-4463-b03a-1825f3d2f699 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:55.431693 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-077f3a7c-1126-4463-b03a-1825f3d2f699 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:55.438316 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-077f3a7c-1126-4463-b03a-1825f3d2f699 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:55.438761 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-077f3a7c-1126-4463-b03a-1825f3d2f699 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:55.439550 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-077f3a7c-1126-4463-b03a-1825f3d2f699 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:55.439979 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-077f3a7c-1126-4463-b03a-1825f3d2f699 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:55.571563 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-077f3a7c-1126-4463-b03a-1825f3d2f699 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:55.579638 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-077f3a7c-1126-4463-b03a-1825f3d2f699 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1721 microversion: 2.1 time: 0.152527 Jun 01 04:32:55.580199 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 267/527] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:32:55 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:32:56.597975 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-753ad4e0-cb78-4397-bcbf-e77eaf655ed0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:56.598687 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-753ad4e0-cb78-4397-bcbf-e77eaf655ed0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:56.606158 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-753ad4e0-cb78-4397-bcbf-e77eaf655ed0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:56.606609 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-753ad4e0-cb78-4397-bcbf-e77eaf655ed0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:56.607402 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-753ad4e0-cb78-4397-bcbf-e77eaf655ed0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:56.607840 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-753ad4e0-cb78-4397-bcbf-e77eaf655ed0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:56.738352 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-753ad4e0-cb78-4397-bcbf-e77eaf655ed0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:56.746304 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-753ad4e0-cb78-4397-bcbf-e77eaf655ed0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1721 microversion: 2.1 time: 0.152786 Jun 01 04:32:56.746864 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 261/528] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:32:56 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:32:57.763740 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-83e532aa-b63a-404d-9a0e-a8114d6397fc tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:57.764351 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-83e532aa-b63a-404d-9a0e-a8114d6397fc tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:57.770818 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-83e532aa-b63a-404d-9a0e-a8114d6397fc tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:57.771261 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-83e532aa-b63a-404d-9a0e-a8114d6397fc tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:57.772055 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-83e532aa-b63a-404d-9a0e-a8114d6397fc tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:57.772484 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-83e532aa-b63a-404d-9a0e-a8114d6397fc tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:57.909361 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-83e532aa-b63a-404d-9a0e-a8114d6397fc tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:57.917606 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-83e532aa-b63a-404d-9a0e-a8114d6397fc tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1721 microversion: 2.1 time: 0.157647 Jun 01 04:32:57.918185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 268/529] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:32:57 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:32:58.159744 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-1cc6798e-5840-4383-8ee2-c35d8ab03612 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:32:58.160769 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-1cc6798e-5840-4383-8ee2-c35d8ab03612 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:58.167925 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1cc6798e-5840-4383-8ee2-c35d8ab03612 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:58.168377 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1cc6798e-5840-4383-8ee2-c35d8ab03612 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:58.169148 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1cc6798e-5840-4383-8ee2-c35d8ab03612 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:58.169585 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1cc6798e-5840-4383-8ee2-c35d8ab03612 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:58.192369 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.objects.instance [None req-1cc6798e-5840-4383-8ee2-c35d8ab03612 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lazy-loading 'flavor' on Instance uuid 9f8eae96-794e-4cdb-a397-0f892e3fd9f0 {{(pid=118517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:32:58.487917 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-1cc6798e-5840-4383-8ee2-c35d8ab03612 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "POST /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0/action" status: 200 len: 32 microversion: 2.1 time: 0.330945 Jun 01 04:32:58.487917 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 262/530] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 1 04:32:58 2022] POST /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0/action => generated 32 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 01 04:32:58.497541 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-4dea2ff5-d353-4444-ba02-f6a899146fe2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:58.498192 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-4dea2ff5-d353-4444-ba02-f6a899146fe2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:58.504618 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4dea2ff5-d353-4444-ba02-f6a899146fe2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:58.505074 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4dea2ff5-d353-4444-ba02-f6a899146fe2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:58.505847 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4dea2ff5-d353-4444-ba02-f6a899146fe2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:58.506286 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4dea2ff5-d353-4444-ba02-f6a899146fe2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:58.669787 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-4dea2ff5-d353-4444-ba02-f6a899146fe2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:58.677974 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-4dea2ff5-d353-4444-ba02-f6a899146fe2 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1734 microversion: 2.1 time: 0.184916 Jun 01 04:32:58.678554 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 269/531] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:32:58 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1734 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:32:58.935954 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-1f1be10b-d255-42db-b56b-31f20c1cc3d6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:58.936661 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-1f1be10b-d255-42db-b56b-31f20c1cc3d6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:58.943197 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1f1be10b-d255-42db-b56b-31f20c1cc3d6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:58.943733 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1f1be10b-d255-42db-b56b-31f20c1cc3d6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:58.944689 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1f1be10b-d255-42db-b56b-31f20c1cc3d6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:58.945105 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1f1be10b-d255-42db-b56b-31f20c1cc3d6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:58.951118 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-7b491423-a640-43d7-8181-21fce04119f3 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:58.951703 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-7b491423-a640-43d7-8181-21fce04119f3 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: ee6bbca6-d73f-46d5-a3b9-684c864dbdaf] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:58.958358 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7b491423-a640-43d7-8181-21fce04119f3 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:58.959465 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7b491423-a640-43d7-8181-21fce04119f3 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:58.959634 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7b491423-a640-43d7-8181-21fce04119f3 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:58.960053 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7b491423-a640-43d7-8181-21fce04119f3 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:58.987436 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-7b491423-a640-43d7-8181-21fce04119f3 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: ee6bbca6-d73f-46d5-a3b9-684c864dbdaf] Going to try to terminate instance {{(pid=118516) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 01 04:32:59.018042 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=100 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:32:59.088482 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-1f1be10b-d255-42db-b56b-31f20c1cc3d6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:59.098016 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-1f1be10b-d255-42db-b56b-31f20c1cc3d6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1721 microversion: 2.1 time: 0.167051 Jun 01 04:32:59.098612 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 263/532] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:32:58 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:32:59.276378 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-7b491423-a640-43d7-8181-21fce04119f3 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf" status: 204 len: 0 microversion: 2.1 time: 0.328880 Jun 01 04:32:59.276971 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 270/533] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 1 04:32:58 2022] DELETE /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 01 04:32:59.285470 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-6bbdbf54-843d-4748-a01c-356b2f526e3d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:59.286147 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-6bbdbf54-843d-4748-a01c-356b2f526e3d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: ee6bbca6-d73f-46d5-a3b9-684c864dbdaf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:59.293420 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6bbdbf54-843d-4748-a01c-356b2f526e3d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:59.293858 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6bbdbf54-843d-4748-a01c-356b2f526e3d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:59.294633 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6bbdbf54-843d-4748-a01c-356b2f526e3d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:59.295062 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6bbdbf54-843d-4748-a01c-356b2f526e3d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:59.439465 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-6bbdbf54-843d-4748-a01c-356b2f526e3d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:59.447358 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-6bbdbf54-843d-4748-a01c-356b2f526e3d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf" status: 200 len: 1512 microversion: 2.1 time: 0.166017 Jun 01 04:32:59.447934 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 264/534] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:32:59 2022] GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:32:59.696446 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-84e3a57e-86ca-4b67-add7-2611c43a5542 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:32:59.697679 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-84e3a57e-86ca-4b67-add7-2611c43a5542 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:32:59.704190 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-84e3a57e-86ca-4b67-add7-2611c43a5542 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:59.704654 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-84e3a57e-86ca-4b67-add7-2611c43a5542 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:59.705432 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-84e3a57e-86ca-4b67-add7-2611c43a5542 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:32:59.705871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-84e3a57e-86ca-4b67-add7-2611c43a5542 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:32:59.846347 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-84e3a57e-86ca-4b67-add7-2611c43a5542 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:32:59.854699 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-84e3a57e-86ca-4b67-add7-2611c43a5542 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1734 microversion: 2.1 time: 0.162465 Jun 01 04:32:59.855282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 271/535] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:32:59 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:00.116122 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-6ef97885-b275-44df-a129-f238b9bf3753 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:00.116713 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-6ef97885-b275-44df-a129-f238b9bf3753 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:00.123351 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6ef97885-b275-44df-a129-f238b9bf3753 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:00.123828 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6ef97885-b275-44df-a129-f238b9bf3753 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:00.124616 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6ef97885-b275-44df-a129-f238b9bf3753 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:00.125046 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6ef97885-b275-44df-a129-f238b9bf3753 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:00.253159 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-6ef97885-b275-44df-a129-f238b9bf3753 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:00.261874 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-6ef97885-b275-44df-a129-f238b9bf3753 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1721 microversion: 2.1 time: 0.149867 Jun 01 04:33:00.266801 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 265/536] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:00 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:00.465137 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-85d8e42e-b383-41f9-85b1-a94774ba0d7a tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:00.465665 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-85d8e42e-b383-41f9-85b1-a94774ba0d7a tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: ee6bbca6-d73f-46d5-a3b9-684c864dbdaf] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:00.472210 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-85d8e42e-b383-41f9-85b1-a94774ba0d7a tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:00.472659 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-85d8e42e-b383-41f9-85b1-a94774ba0d7a tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:00.473419 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-85d8e42e-b383-41f9-85b1-a94774ba0d7a tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:00.473856 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-85d8e42e-b383-41f9-85b1-a94774ba0d7a tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:00.601089 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-85d8e42e-b383-41f9-85b1-a94774ba0d7a tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:00.608979 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-85d8e42e-b383-41f9-85b1-a94774ba0d7a tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf" status: 200 len: 1512 microversion: 2.1 time: 0.147814 Jun 01 04:33:00.609542 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 272/537] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:00 2022] GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf => generated 1512 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:00.873283 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-436cef10-807a-4522-b7f3-55449d58b7dc tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:00.873869 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-436cef10-807a-4522-b7f3-55449d58b7dc tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:00.880822 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-436cef10-807a-4522-b7f3-55449d58b7dc tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:00.881266 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-436cef10-807a-4522-b7f3-55449d58b7dc tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:00.882030 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-436cef10-807a-4522-b7f3-55449d58b7dc tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:00.882468 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-436cef10-807a-4522-b7f3-55449d58b7dc tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:01.016425 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-436cef10-807a-4522-b7f3-55449d58b7dc tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:01.024673 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-436cef10-807a-4522-b7f3-55449d58b7dc tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1734 microversion: 2.1 time: 0.155763 Jun 01 04:33:01.025756 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 266/538] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:00 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:01.280079 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-bdfbba19-86da-47a0-b8c2-f8e7e9b80650 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:01.280695 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-bdfbba19-86da-47a0-b8c2-f8e7e9b80650 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:01.286683 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bdfbba19-86da-47a0-b8c2-f8e7e9b80650 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:01.287133 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bdfbba19-86da-47a0-b8c2-f8e7e9b80650 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:01.287932 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bdfbba19-86da-47a0-b8c2-f8e7e9b80650 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:01.288371 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bdfbba19-86da-47a0-b8c2-f8e7e9b80650 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:01.417129 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-bdfbba19-86da-47a0-b8c2-f8e7e9b80650 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:01.425509 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-bdfbba19-86da-47a0-b8c2-f8e7e9b80650 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1721 microversion: 2.1 time: 0.149215 Jun 01 04:33:01.426076 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 273/539] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:01 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:01.628083 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-b18ad44d-ea32-4161-8b1e-22fac77e1fa2 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:01.628695 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-b18ad44d-ea32-4161-8b1e-22fac77e1fa2 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: ee6bbca6-d73f-46d5-a3b9-684c864dbdaf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:01.635964 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b18ad44d-ea32-4161-8b1e-22fac77e1fa2 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:01.635964 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b18ad44d-ea32-4161-8b1e-22fac77e1fa2 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:01.636746 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b18ad44d-ea32-4161-8b1e-22fac77e1fa2 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:01.637179 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b18ad44d-ea32-4161-8b1e-22fac77e1fa2 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:01.763441 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-b18ad44d-ea32-4161-8b1e-22fac77e1fa2 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:01.770848 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-b18ad44d-ea32-4161-8b1e-22fac77e1fa2 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf" status: 200 len: 1512 microversion: 2.1 time: 0.146567 Jun 01 04:33:01.771438 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 267/540] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:01 2022] GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf => generated 1512 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:02.042829 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-89ad9501-b911-4c11-b57a-b108fa6d4ec7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:02.043470 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-89ad9501-b911-4c11-b57a-b108fa6d4ec7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:02.050078 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-89ad9501-b911-4c11-b57a-b108fa6d4ec7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:02.050459 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-89ad9501-b911-4c11-b57a-b108fa6d4ec7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:02.056840 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-89ad9501-b911-4c11-b57a-b108fa6d4ec7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:02.056840 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-89ad9501-b911-4c11-b57a-b108fa6d4ec7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:02.192899 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-89ad9501-b911-4c11-b57a-b108fa6d4ec7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:02.200923 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-89ad9501-b911-4c11-b57a-b108fa6d4ec7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1734 microversion: 2.1 time: 0.162809 Jun 01 04:33:02.201509 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 274/541] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:02 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:02.283423 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-6b92bd1f-b50d-4efc-9d54-69141fa744bd req-5b048e17-305f-46a8-9ffd-f446dab299ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6bbca6-d73f-46d5-a3b9-684c864dbdaf", "name": "network-vif-deleted", "tag": "8138db02-b358-48b3-8480-cfead95744b4"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:33:02.293167 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-6b92bd1f-b50d-4efc-9d54-69141fa744bd req-5b048e17-305f-46a8-9ffd-f446dab299ec service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:02.293613 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-6b92bd1f-b50d-4efc-9d54-69141fa744bd req-5b048e17-305f-46a8-9ffd-f446dab299ec service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:02.304707 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-6b92bd1f-b50d-4efc-9d54-69141fa744bd req-5b048e17-305f-46a8-9ffd-f446dab299ec service nova] Creating event network-vif-deleted:8138db02-b358-48b3-8480-cfead95744b4 for instance ee6bbca6-d73f-46d5-a3b9-684c864dbdaf on hv-cinder-66710 Jun 01 04:33:02.309609 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-6b92bd1f-b50d-4efc-9d54-69141fa744bd req-5b048e17-305f-46a8-9ffd-f446dab299ec service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029970 Jun 01 04:33:02.310191 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 268/542] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:33:02.442158 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-9ed0f72c-71ad-49b7-be4c-23e62ec63b87 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:02.442685 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-9ed0f72c-71ad-49b7-be4c-23e62ec63b87 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:02.448771 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9ed0f72c-71ad-49b7-be4c-23e62ec63b87 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:02.449227 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9ed0f72c-71ad-49b7-be4c-23e62ec63b87 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:02.449994 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9ed0f72c-71ad-49b7-be4c-23e62ec63b87 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:02.450434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9ed0f72c-71ad-49b7-be4c-23e62ec63b87 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:02.576644 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-9ed0f72c-71ad-49b7-be4c-23e62ec63b87 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:02.584646 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-9ed0f72c-71ad-49b7-be4c-23e62ec63b87 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1721 microversion: 2.1 time: 0.146532 Jun 01 04:33:02.585214 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 275/543] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:02 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:02.788440 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-760b2ed2-780d-42ad-834c-9e10111aa137 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:02.789141 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-760b2ed2-780d-42ad-834c-9e10111aa137 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: ee6bbca6-d73f-46d5-a3b9-684c864dbdaf] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:02.795724 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-760b2ed2-780d-42ad-834c-9e10111aa137 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:02.796182 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-760b2ed2-780d-42ad-834c-9e10111aa137 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:02.796953 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-760b2ed2-780d-42ad-834c-9e10111aa137 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:02.797395 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-760b2ed2-780d-42ad-834c-9e10111aa137 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:02.827784 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-760b2ed2-780d-42ad-834c-9e10111aa137 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:02.828231 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-760b2ed2-780d-42ad-834c-9e10111aa137 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:02.828678 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.objects.instance [None req-760b2ed2-780d-42ad-834c-9e10111aa137 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lazy-loading 'fault' on Instance uuid ee6bbca6-d73f-46d5-a3b9-684c864dbdaf {{(pid=118517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:33:02.869573 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-760b2ed2-780d-42ad-834c-9e10111aa137 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:02.876814 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-760b2ed2-780d-42ad-834c-9e10111aa137 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf" status: 200 len: 1308 microversion: 2.1 time: 0.092583 Jun 01 04:33:02.877370 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 269/544] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:02 2022] GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:03.218008 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-e429cc7f-8b5c-4eb5-8b3d-df8da1f12af7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:03.218652 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-e429cc7f-8b5c-4eb5-8b3d-df8da1f12af7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:03.225216 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e429cc7f-8b5c-4eb5-8b3d-df8da1f12af7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:03.225651 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e429cc7f-8b5c-4eb5-8b3d-df8da1f12af7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:03.226418 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e429cc7f-8b5c-4eb5-8b3d-df8da1f12af7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:03.226883 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e429cc7f-8b5c-4eb5-8b3d-df8da1f12af7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:03.368464 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-e429cc7f-8b5c-4eb5-8b3d-df8da1f12af7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:03.377185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-e429cc7f-8b5c-4eb5-8b3d-df8da1f12af7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1734 microversion: 2.1 time: 0.162986 Jun 01 04:33:03.377742 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 276/545] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:03 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:03.602035 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-c5395170-ec3a-431d-9aff-e5c6f5d89eb0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:03.602634 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-c5395170-ec3a-431d-9aff-e5c6f5d89eb0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:03.609536 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c5395170-ec3a-431d-9aff-e5c6f5d89eb0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:03.609967 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c5395170-ec3a-431d-9aff-e5c6f5d89eb0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:03.610728 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c5395170-ec3a-431d-9aff-e5c6f5d89eb0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:03.611159 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c5395170-ec3a-431d-9aff-e5c6f5d89eb0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:03.741520 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-c5395170-ec3a-431d-9aff-e5c6f5d89eb0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:03.750084 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-c5395170-ec3a-431d-9aff-e5c6f5d89eb0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1721 microversion: 2.1 time: 0.151931 Jun 01 04:33:03.750643 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 270/546] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:03 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:03.894126 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-a232f2d8-a09b-45df-975e-bb5fcc19f4b5 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:03.894801 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-a232f2d8-a09b-45df-975e-bb5fcc19f4b5 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: ee6bbca6-d73f-46d5-a3b9-684c864dbdaf] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:03.901415 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a232f2d8-a09b-45df-975e-bb5fcc19f4b5 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:03.901867 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a232f2d8-a09b-45df-975e-bb5fcc19f4b5 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:03.902631 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a232f2d8-a09b-45df-975e-bb5fcc19f4b5 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:03.903071 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a232f2d8-a09b-45df-975e-bb5fcc19f4b5 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:03.917123 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.wsgi [None req-a232f2d8-a09b-45df-975e-bb5fcc19f4b5 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] HTTP exception thrown: Instance ee6bbca6-d73f-46d5-a3b9-684c864dbdaf could not be found. Jun 01 04:33:03.925549 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-a232f2d8-a09b-45df-975e-bb5fcc19f4b5 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Request method failure captured: Jun 01 04:33:03.925549 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: request: GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf HTTP/1.1 Jun 01 04:33:03.925549 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept: application/json Jun 01 04:33:03.925549 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept-Encoding: identity Jun 01 04:33:03.925549 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Connection: close Jun 01 04:33:03.925549 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Length: 0 Jun 01 04:33:03.925549 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Type: application/json Jun 01 04:33:03.925549 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Host: 10.222.0.18 Jun 01 04:33:03.925549 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Openstack-System-Scope: None Jun 01 04:33:03.925549 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: User-Agent: python-urllib3/1.26.9 Jun 01 04:33:03.925549 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Auth-Token: gAAAAABiluuhrs68vRS8bmHX79HSLEC7Oto5BPtL8dAqHvw4xcvjDwmHZOq4iDquAqCiMvb88J6MD56RYbs0QMO2u_wuPhclaOhGjnf2V4BFXnnyauRkH0EWaJk48PQGCqHRBrxvcy_7Fcw0OlUZ5qUTBgWhVmwbyO4Ssx0EAbp5AaHN0b0jRNM Jun 01 04:33:03.925549 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Id: None Jun 01 04:33:03.925549 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Name: None Jun 01 04:33:03.925549 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Identity-Status: Confirmed Jun 01 04:33:03.925549 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Is-Admin-Project: True Jun 01 04:33:03.925549 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Id: default Jun 01 04:33:03.925549 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Name: Default Jun 01 04:33:03.925549 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Id: 7454aaeeba6b4a8c86a0446ae68dd4f1 Jun 01 04:33:03.925549 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1313661018 Jun 01 04:33:03.925549 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Role: reader,member Jun 01 04:33:03.925549 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Roles: reader,member Jun 01 04:33:03.927240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7454aaeeba6b4a8c86a0446ae68dd4f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7454aaeeba6b4a8c86a0446ae68dd4f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7454aaeeba6b4a8c86a0446ae68dd4f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7454aaeeba6b4a8c86a0446ae68dd4f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:33:03.927240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant: tempest-VolumesSnapshotTestJSON-1313661018 Jun 01 04:33:03.927240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Id: 7454aaeeba6b4a8c86a0446ae68dd4f1 Jun 01 04:33:03.927240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1313661018 Jun 01 04:33:03.927240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User: tempest-VolumesSnapshotTestJSON-1313661018-project Jun 01 04:33:03.927240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Id: default Jun 01 04:33:03.927240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Name: Default Jun 01 04:33:03.927240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Id: e249c6bada9d4dcb91b83a0a29ad552d Jun 01 04:33:03.927240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Name: tempest-VolumesSnapshotTestJSON-1313661018-project Jun 01 04:33:03.927240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: method: > Jun 01 04:33:03.927240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: exception: Instance ee6bbca6-d73f-46d5-a3b9-684c864dbdaf could not be found. Jun 01 04:33:03.927240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: action_args: {'id': 'ee6bbca6-d73f-46d5-a3b9-684c864dbdaf'} Jun 01 04:33:03.928146 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:33:03.928146 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:33:03.928146 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:33:03.928146 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:33:03.928146 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:33:03.928146 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:33:03.928146 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:33:03.928146 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:33:03.928146 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:33:03.928146 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:33:03.928146 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee6bbca6-d73f-46d5-a3b9-684c864dbdaf could not be found. Jun 01 04:33:03.928146 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:33:03.928146 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:33:03.928146 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:33:03.928146 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:33:03.928146 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:33:03.928146 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:33:03.928146 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:33:03.928146 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:33:03.928146 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:33:03.929389 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:33:03.929389 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 01 04:33:03.929389 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 01 04:33:03.929389 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:33:03.929389 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:33:03.929389 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:33:03.929389 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:33:03.929389 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee6bbca6-d73f-46d5-a3b9-684c864dbdaf could not be found. Jun 01 04:33:03.929389 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:33:03.929389 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:33:03.929389 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:33:03.929389 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:33:03.929389 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:33:03.929389 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:33:03.929389 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:33:03.929389 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:33:03.929389 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee6bbca6-d73f-46d5-a3b9-684c864dbdaf could not be found. Jun 01 04:33:03.929389 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:33:03.930491 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-a232f2d8-a09b-45df-975e-bb5fcc19f4b5 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Returning 404 to user: Instance ee6bbca6-d73f-46d5-a3b9-684c864dbdaf could not be found. {{(pid=118516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:33:03.930491 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-a232f2d8-a09b-45df-975e-bb5fcc19f4b5 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf" status: 404 len: 111 microversion: 2.1 time: 0.029963 Jun 01 04:33:03.930491 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 277/547] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:03 2022] GET /compute/v2.1/servers/ee6bbca6-d73f-46d5-a3b9-684c864dbdaf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:33:04.395718 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-38744aac-788f-4224-b1e6-5f1605a3ace0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:04.396326 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-38744aac-788f-4224-b1e6-5f1605a3ace0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:04.402910 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-38744aac-788f-4224-b1e6-5f1605a3ace0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:04.403386 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-38744aac-788f-4224-b1e6-5f1605a3ace0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:04.404144 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-38744aac-788f-4224-b1e6-5f1605a3ace0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:04.404614 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-38744aac-788f-4224-b1e6-5f1605a3ace0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:04.419332 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:04.536417 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-38744aac-788f-4224-b1e6-5f1605a3ace0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:04.544712 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-38744aac-788f-4224-b1e6-5f1605a3ace0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1734 microversion: 2.1 time: 0.153299 Jun 01 04:33:04.545350 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 271/548] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:04 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:04.766892 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-12981b9b-317a-48ce-b481-c01eb234e711 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:04.767447 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-12981b9b-317a-48ce-b481-c01eb234e711 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:04.773631 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-12981b9b-317a-48ce-b481-c01eb234e711 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:04.774079 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-12981b9b-317a-48ce-b481-c01eb234e711 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:04.774836 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-12981b9b-317a-48ce-b481-c01eb234e711 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:04.775293 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-12981b9b-317a-48ce-b481-c01eb234e711 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:04.903416 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-12981b9b-317a-48ce-b481-c01eb234e711 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:04.911814 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-12981b9b-317a-48ce-b481-c01eb234e711 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1721 microversion: 2.1 time: 0.148835 Jun 01 04:33:04.912375 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 278/549] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:04 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:05.562446 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-4e0d1578-d7e3-44d2-bd17-ad4f916aa0d6 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:05.562981 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-4e0d1578-d7e3-44d2-bd17-ad4f916aa0d6 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:05.569808 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4e0d1578-d7e3-44d2-bd17-ad4f916aa0d6 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:05.570253 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4e0d1578-d7e3-44d2-bd17-ad4f916aa0d6 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:05.571006 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4e0d1578-d7e3-44d2-bd17-ad4f916aa0d6 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:05.571466 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4e0d1578-d7e3-44d2-bd17-ad4f916aa0d6 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:05.709313 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-4e0d1578-d7e3-44d2-bd17-ad4f916aa0d6 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:05.717798 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-4e0d1578-d7e3-44d2-bd17-ad4f916aa0d6 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1734 microversion: 2.1 time: 0.159238 Jun 01 04:33:05.718366 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 272/550] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:05 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:05.929306 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-2a7ef480-724e-4705-8dcf-1745f94c9822 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:05.929835 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-2a7ef480-724e-4705-8dcf-1745f94c9822 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:05.936888 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2a7ef480-724e-4705-8dcf-1745f94c9822 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:05.937334 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2a7ef480-724e-4705-8dcf-1745f94c9822 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:05.938093 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2a7ef480-724e-4705-8dcf-1745f94c9822 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:05.938526 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2a7ef480-724e-4705-8dcf-1745f94c9822 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:06.065457 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-2a7ef480-724e-4705-8dcf-1745f94c9822 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:06.074202 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-2a7ef480-724e-4705-8dcf-1745f94c9822 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1721 microversion: 2.1 time: 0.148852 Jun 01 04:33:06.074773 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 279/551] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:05 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:06.735184 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a7131445-450b-477c-9aa2-7cd56e4fe347 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:06.735743 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-a7131445-450b-477c-9aa2-7cd56e4fe347 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:06.742374 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a7131445-450b-477c-9aa2-7cd56e4fe347 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:06.742816 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a7131445-450b-477c-9aa2-7cd56e4fe347 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:06.743602 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a7131445-450b-477c-9aa2-7cd56e4fe347 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:06.744033 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a7131445-450b-477c-9aa2-7cd56e4fe347 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:06.871037 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-a7131445-450b-477c-9aa2-7cd56e4fe347 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:06.878921 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-a7131445-450b-477c-9aa2-7cd56e4fe347 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1734 microversion: 2.1 time: 0.147607 Jun 01 04:33:06.879510 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 273/552] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:06 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:07.093161 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-aefdc416-d93b-4818-99a5-1516a1016b0d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:07.094102 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-aefdc416-d93b-4818-99a5-1516a1016b0d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:07.100418 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-aefdc416-d93b-4818-99a5-1516a1016b0d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:07.100867 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-aefdc416-d93b-4818-99a5-1516a1016b0d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:07.101632 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-aefdc416-d93b-4818-99a5-1516a1016b0d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:07.102069 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-aefdc416-d93b-4818-99a5-1516a1016b0d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:07.232613 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-aefdc416-d93b-4818-99a5-1516a1016b0d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:07.241051 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-aefdc416-d93b-4818-99a5-1516a1016b0d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1721 microversion: 2.1 time: 0.152577 Jun 01 04:33:07.241608 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 280/553] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:07 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:07.896566 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-fbf10d18-35ed-4b54-9121-31a178b2489c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:07.897177 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-fbf10d18-35ed-4b54-9121-31a178b2489c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:07.903654 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-fbf10d18-35ed-4b54-9121-31a178b2489c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:07.904103 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-fbf10d18-35ed-4b54-9121-31a178b2489c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:07.904862 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-fbf10d18-35ed-4b54-9121-31a178b2489c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:07.905298 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-fbf10d18-35ed-4b54-9121-31a178b2489c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:08.030706 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-fbf10d18-35ed-4b54-9121-31a178b2489c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:08.038797 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-fbf10d18-35ed-4b54-9121-31a178b2489c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1734 microversion: 2.1 time: 0.146050 Jun 01 04:33:08.039364 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 274/554] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:07 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:08.257147 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-4a68b67a-2b32-4a8c-b439-682397a36529 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:08.257675 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-4a68b67a-2b32-4a8c-b439-682397a36529 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:08.264198 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4a68b67a-2b32-4a8c-b439-682397a36529 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:08.264644 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4a68b67a-2b32-4a8c-b439-682397a36529 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:08.265398 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4a68b67a-2b32-4a8c-b439-682397a36529 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:08.265830 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4a68b67a-2b32-4a8c-b439-682397a36529 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:08.392280 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-4a68b67a-2b32-4a8c-b439-682397a36529 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:08.400804 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-4a68b67a-2b32-4a8c-b439-682397a36529 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1721 microversion: 2.1 time: 0.147126 Jun 01 04:33:08.401358 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 281/555] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:08 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:09.056637 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-bf7bbe43-951a-4966-a5d5-98591fd0c1d4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:09.057966 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-bf7bbe43-951a-4966-a5d5-98591fd0c1d4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:09.064578 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bf7bbe43-951a-4966-a5d5-98591fd0c1d4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:09.065146 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bf7bbe43-951a-4966-a5d5-98591fd0c1d4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:09.065914 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bf7bbe43-951a-4966-a5d5-98591fd0c1d4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:09.066346 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bf7bbe43-951a-4966-a5d5-98591fd0c1d4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:09.194827 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-bf7bbe43-951a-4966-a5d5-98591fd0c1d4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:09.203248 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-bf7bbe43-951a-4966-a5d5-98591fd0c1d4 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1734 microversion: 2.1 time: 0.150926 Jun 01 04:33:09.203837 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 275/556] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:09 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:09.418381 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-7f9720d3-acb1-491c-b879-64acc34852c0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:09.418989 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-7f9720d3-acb1-491c-b879-64acc34852c0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:09.425884 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7f9720d3-acb1-491c-b879-64acc34852c0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:09.426329 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7f9720d3-acb1-491c-b879-64acc34852c0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:09.427093 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7f9720d3-acb1-491c-b879-64acc34852c0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:09.427556 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7f9720d3-acb1-491c-b879-64acc34852c0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:09.558478 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-7f9720d3-acb1-491c-b879-64acc34852c0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:09.566499 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-7f9720d3-acb1-491c-b879-64acc34852c0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1721 microversion: 2.1 time: 0.152500 Jun 01 04:33:09.567220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 282/557] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:09 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:10.220742 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-6d799337-4afc-4a29-997d-ac302d2c4980 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:10.221393 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-6d799337-4afc-4a29-997d-ac302d2c4980 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:10.228051 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6d799337-4afc-4a29-997d-ac302d2c4980 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:10.228533 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6d799337-4afc-4a29-997d-ac302d2c4980 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:10.230455 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6d799337-4afc-4a29-997d-ac302d2c4980 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:10.230619 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6d799337-4afc-4a29-997d-ac302d2c4980 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:10.360387 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-6d799337-4afc-4a29-997d-ac302d2c4980 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:10.368708 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-6d799337-4afc-4a29-997d-ac302d2c4980 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1734 microversion: 2.1 time: 0.151963 Jun 01 04:33:10.369276 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 276/558] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:10 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:10.583577 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-dfb5317f-bf62-4e77-aab3-7cac05584d51 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:10.584190 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-dfb5317f-bf62-4e77-aab3-7cac05584d51 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:10.591396 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-dfb5317f-bf62-4e77-aab3-7cac05584d51 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:10.591850 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-dfb5317f-bf62-4e77-aab3-7cac05584d51 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:10.592610 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-dfb5317f-bf62-4e77-aab3-7cac05584d51 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:10.593050 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-dfb5317f-bf62-4e77-aab3-7cac05584d51 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:10.716858 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-dfb5317f-bf62-4e77-aab3-7cac05584d51 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:10.724779 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-dfb5317f-bf62-4e77-aab3-7cac05584d51 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1721 microversion: 2.1 time: 0.145097 Jun 01 04:33:10.725344 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 283/559] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:10 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:11.385314 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-1eade28b-796b-4cb1-af49-c234b4ea0ed6 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:11.385961 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-1eade28b-796b-4cb1-af49-c234b4ea0ed6 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:11.392307 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1eade28b-796b-4cb1-af49-c234b4ea0ed6 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:11.392921 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1eade28b-796b-4cb1-af49-c234b4ea0ed6 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:11.393809 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1eade28b-796b-4cb1-af49-c234b4ea0ed6 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:11.394238 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1eade28b-796b-4cb1-af49-c234b4ea0ed6 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:11.528869 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-1eade28b-796b-4cb1-af49-c234b4ea0ed6 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:11.536860 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-1eade28b-796b-4cb1-af49-c234b4ea0ed6 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1734 microversion: 2.1 time: 0.155333 Jun 01 04:33:11.537419 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 277/560] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:11 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:33:11.742142 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-39dc3958-63cc-4f8b-98c7-d2cce0cb1900 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:11.742659 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-39dc3958-63cc-4f8b-98c7-d2cce0cb1900 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:11.749078 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-39dc3958-63cc-4f8b-98c7-d2cce0cb1900 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:11.749523 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-39dc3958-63cc-4f8b-98c7-d2cce0cb1900 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:11.750302 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-39dc3958-63cc-4f8b-98c7-d2cce0cb1900 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:11.750735 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-39dc3958-63cc-4f8b-98c7-d2cce0cb1900 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:11.874593 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-39dc3958-63cc-4f8b-98c7-d2cce0cb1900 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:11.882709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-39dc3958-63cc-4f8b-98c7-d2cce0cb1900 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1721 microversion: 2.1 time: 0.144513 Jun 01 04:33:11.883267 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 284/561] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:11 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:12.553853 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-3e92f3e7-aaea-4dd0-ac6b-338d43dfa27b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:12.554462 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-3e92f3e7-aaea-4dd0-ac6b-338d43dfa27b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:12.561423 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3e92f3e7-aaea-4dd0-ac6b-338d43dfa27b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:12.561869 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3e92f3e7-aaea-4dd0-ac6b-338d43dfa27b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:12.562630 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3e92f3e7-aaea-4dd0-ac6b-338d43dfa27b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:12.563094 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3e92f3e7-aaea-4dd0-ac6b-338d43dfa27b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:12.692225 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-3e92f3e7-aaea-4dd0-ac6b-338d43dfa27b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:12.701095 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-3e92f3e7-aaea-4dd0-ac6b-338d43dfa27b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1734 microversion: 2.1 time: 0.151075 Jun 01 04:33:12.701665 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 278/562] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:12 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:12.900031 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-3ccb50e6-b61f-47ac-8dbf-3d101d0f0321 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:12.900580 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-3ccb50e6-b61f-47ac-8dbf-3d101d0f0321 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:12.907283 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3ccb50e6-b61f-47ac-8dbf-3d101d0f0321 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:12.907770 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3ccb50e6-b61f-47ac-8dbf-3d101d0f0321 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:12.908553 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3ccb50e6-b61f-47ac-8dbf-3d101d0f0321 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:12.909024 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3ccb50e6-b61f-47ac-8dbf-3d101d0f0321 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:13.041048 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-3ccb50e6-b61f-47ac-8dbf-3d101d0f0321 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:13.049886 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-3ccb50e6-b61f-47ac-8dbf-3d101d0f0321 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1721 microversion: 2.1 time: 0.153787 Jun 01 04:33:13.050448 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 285/563] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:12 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:13.718686 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-4f1afac3-1ff0-4401-bd0f-6982f4449653 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:13.719288 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-4f1afac3-1ff0-4401-bd0f-6982f4449653 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:13.726115 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4f1afac3-1ff0-4401-bd0f-6982f4449653 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:13.726562 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4f1afac3-1ff0-4401-bd0f-6982f4449653 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:13.727348 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4f1afac3-1ff0-4401-bd0f-6982f4449653 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:13.727787 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4f1afac3-1ff0-4401-bd0f-6982f4449653 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:13.858327 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-4f1afac3-1ff0-4401-bd0f-6982f4449653 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:13.866928 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-4f1afac3-1ff0-4401-bd0f-6982f4449653 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1734 microversion: 2.1 time: 0.152003 Jun 01 04:33:13.867505 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 279/564] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:13 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:14.067673 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-5861458d-7478-426a-8a2b-cc09df9b7e0d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:14.068288 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-5861458d-7478-426a-8a2b-cc09df9b7e0d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:14.074791 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5861458d-7478-426a-8a2b-cc09df9b7e0d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:14.075247 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5861458d-7478-426a-8a2b-cc09df9b7e0d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:14.076049 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5861458d-7478-426a-8a2b-cc09df9b7e0d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:14.076497 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5861458d-7478-426a-8a2b-cc09df9b7e0d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:14.202658 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-5861458d-7478-426a-8a2b-cc09df9b7e0d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:14.210591 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-5861458d-7478-426a-8a2b-cc09df9b7e0d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1721 microversion: 2.1 time: 0.146785 Jun 01 04:33:14.211151 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 286/565] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:14 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:14.883431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-3bb5b574-fc62-4e2a-bb12-137cf8242746 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:14.883995 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-3bb5b574-fc62-4e2a-bb12-137cf8242746 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:14.891258 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3bb5b574-fc62-4e2a-bb12-137cf8242746 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:14.891740 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3bb5b574-fc62-4e2a-bb12-137cf8242746 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:14.892619 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3bb5b574-fc62-4e2a-bb12-137cf8242746 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:14.892933 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3bb5b574-fc62-4e2a-bb12-137cf8242746 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:15.026119 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-3bb5b574-fc62-4e2a-bb12-137cf8242746 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:15.034299 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-3bb5b574-fc62-4e2a-bb12-137cf8242746 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1734 microversion: 2.1 time: 0.154761 Jun 01 04:33:15.034867 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 280/566] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:14 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:15.227640 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-a7442453-3990-4a7a-af59-9366dba4d5e0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:15.228254 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-a7442453-3990-4a7a-af59-9366dba4d5e0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:15.231254 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:15.236103 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a7442453-3990-4a7a-af59-9366dba4d5e0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:15.240220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a7442453-3990-4a7a-af59-9366dba4d5e0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:15.240220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a7442453-3990-4a7a-af59-9366dba4d5e0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:15.240220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a7442453-3990-4a7a-af59-9366dba4d5e0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:15.242093 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:15.382764 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-a7442453-3990-4a7a-af59-9366dba4d5e0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:15.391444 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-a7442453-3990-4a7a-af59-9366dba4d5e0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1698 microversion: 2.1 time: 0.167652 Jun 01 04:33:15.392036 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 287/567] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:15 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1698 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:15.409055 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a47cd5a4-d7ad-4ef2-a74f-98843dc46a51 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:33:15.415929 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a47cd5a4-d7ad-4ef2-a74f-98843dc46a51 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:15.416674 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a47cd5a4-d7ad-4ef2-a74f-98843dc46a51 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:15.435010 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-12017fd7-99a1-4331-b433-c169b36694ae tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1401987977", "imageRef": "14321baa-3ac5-4c53-8054-4945abce5b2d", "flavorRef": "452", "networks": [{"uuid": "42562544-f7d5-495e-a6f5-6fc15fd8a536"}]}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:33:15.439807 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-a47cd5a4-d7ad-4ef2-a74f-98843dc46a51 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Going to try to start instance {{(pid=118517) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 01 04:33:15.490415 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.network.neutron [None req-12017fd7-99a1-4331-b433-c169b36694ae tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] validate_networks() for [('42562544-f7d5-495e-a6f5-6fc15fd8a536', None, None, None, None, None)] {{(pid=118516) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 01 04:33:15.720832 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-a47cd5a4-d7ad-4ef2-a74f-98843dc46a51 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "POST /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95/action" status: 202 len: 0 microversion: 2.1 time: 0.315697 Jun 01 04:33:15.721429 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 281/568] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 1 04:33:15 2022] POST /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 01 04:33:15.736842 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-924bdb65-b8f3-4fc9-8f3f-a77799e29141 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:15.736842 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-924bdb65-b8f3-4fc9-8f3f-a77799e29141 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:15.740319 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-924bdb65-b8f3-4fc9-8f3f-a77799e29141 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:15.740864 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-924bdb65-b8f3-4fc9-8f3f-a77799e29141 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:15.741834 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-924bdb65-b8f3-4fc9-8f3f-a77799e29141 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:15.742435 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-924bdb65-b8f3-4fc9-8f3f-a77799e29141 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:15.876900 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-924bdb65-b8f3-4fc9-8f3f-a77799e29141 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:15.885320 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-924bdb65-b8f3-4fc9-8f3f-a77799e29141 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1707 microversion: 2.1 time: 0.157989 Jun 01 04:33:15.885975 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 282/569] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:15 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1707 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:33:15.888987 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-12017fd7-99a1-4331-b433-c169b36694ae tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Flavor limits 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 01 04:33:15.889514 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-12017fd7-99a1-4331-b433-c169b36694ae tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Image limits 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 01 04:33:15.890150 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-12017fd7-99a1-4331-b433-c169b36694ae tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Flavor pref 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 01 04:33:15.890567 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-12017fd7-99a1-4331-b433-c169b36694ae tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Image pref 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 01 04:33:15.890975 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-12017fd7-99a1-4331-b433-c169b36694ae tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 01 04:33:15.900063 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-12017fd7-99a1-4331-b433-c169b36694ae tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:15.900535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-12017fd7-99a1-4331-b433-c169b36694ae tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:15.901321 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-12017fd7-99a1-4331-b433-c169b36694ae tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:15.901761 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-12017fd7-99a1-4331-b433-c169b36694ae tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:15.919857 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-12017fd7-99a1-4331-b433-c169b36694ae tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Getting quotas for project 7454aaeeba6b4a8c86a0446ae68dd4f1. Resources: {'ram', 'instances', 'cores'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:33:15.924641 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-12017fd7-99a1-4331-b433-c169b36694ae tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Getting quotas for user e249c6bada9d4dcb91b83a0a29ad552d and project 7454aaeeba6b4a8c86a0446ae68dd4f1. Resources: {'ram', 'instances', 'cores'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:33:15.936230 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-12017fd7-99a1-4331-b433-c169b36694ae tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Going to run 1 instances... {{(pid=118516) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 01 04:33:15.938528 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-12017fd7-99a1-4331-b433-c169b36694ae tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: 8cacd474-e05d-4ec8-a35f-c111ca326544] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14321baa-3ac5-4c53-8054-4945abce5b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 01 04:33:16.052123 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-6bd5f8d0-474f-4436-b305-49a2d15a0e0a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:16.052734 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-6bd5f8d0-474f-4436-b305-49a2d15a0e0a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:16.059331 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6bd5f8d0-474f-4436-b305-49a2d15a0e0a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:16.059798 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6bd5f8d0-474f-4436-b305-49a2d15a0e0a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:16.060571 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6bd5f8d0-474f-4436-b305-49a2d15a0e0a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:16.061010 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6bd5f8d0-474f-4436-b305-49a2d15a0e0a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:16.086225 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-12017fd7-99a1-4331-b433-c169b36694ae tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.655014 Jun 01 04:33:16.091336 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 288/570] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 1 04:33:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 01 04:33:16.100326 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d263a0c5-a218-4589-b05f-09106ba904d3 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:16.100938 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-d263a0c5-a218-4589-b05f-09106ba904d3 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: 8cacd474-e05d-4ec8-a35f-c111ca326544] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:16.164877 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-d263a0c5-a218-4589-b05f-09106ba904d3 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:16.175806 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-d263a0c5-a218-4589-b05f-09106ba904d3 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544" status: 200 len: 1219 microversion: 2.1 time: 0.078922 Jun 01 04:33:16.176382 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 289/571] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:16 2022] GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:16.221207 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-6bd5f8d0-474f-4436-b305-49a2d15a0e0a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:16.231854 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-6bd5f8d0-474f-4436-b305-49a2d15a0e0a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1734 microversion: 2.1 time: 0.183688 Jun 01 04:33:16.232425 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 283/572] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:16 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1734 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:33:16.903711 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-a6eb4e2d-ab2c-4044-ab1d-0d1e690b8bf9 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:16.904333 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-a6eb4e2d-ab2c-4044-ab1d-0d1e690b8bf9 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:16.911590 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a6eb4e2d-ab2c-4044-ab1d-0d1e690b8bf9 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:16.912044 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a6eb4e2d-ab2c-4044-ab1d-0d1e690b8bf9 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:16.912818 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a6eb4e2d-ab2c-4044-ab1d-0d1e690b8bf9 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:16.913260 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a6eb4e2d-ab2c-4044-ab1d-0d1e690b8bf9 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:17.047101 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-a6eb4e2d-ab2c-4044-ab1d-0d1e690b8bf9 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:17.055151 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-a6eb4e2d-ab2c-4044-ab1d-0d1e690b8bf9 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1707 microversion: 2.1 time: 0.155831 Jun 01 04:33:17.055750 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 290/573] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:16 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1707 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:17.192958 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-f37518e5-a07b-4230-a710-23c622cab271 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:17.193563 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-f37518e5-a07b-4230-a710-23c622cab271 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: 8cacd474-e05d-4ec8-a35f-c111ca326544] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:17.200333 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f37518e5-a07b-4230-a710-23c622cab271 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:17.202659 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f37518e5-a07b-4230-a710-23c622cab271 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:17.202659 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f37518e5-a07b-4230-a710-23c622cab271 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:17.202659 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f37518e5-a07b-4230-a710-23c622cab271 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:17.249434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-12a682d8-3937-41cb-b4d2-d984c1f44eec tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:17.250040 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-12a682d8-3937-41cb-b4d2-d984c1f44eec tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:17.257827 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-12a682d8-3937-41cb-b4d2-d984c1f44eec tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:17.258283 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-12a682d8-3937-41cb-b4d2-d984c1f44eec tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:17.259067 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-12a682d8-3937-41cb-b4d2-d984c1f44eec tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:17.259982 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-12a682d8-3937-41cb-b4d2-d984c1f44eec tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:17.264536 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-f37518e5-a07b-4230-a710-23c622cab271 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:17.272762 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-f37518e5-a07b-4230-a710-23c622cab271 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544" status: 200 len: 1223 microversion: 2.1 time: 0.083993 Jun 01 04:33:17.273660 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 284/574] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:17 2022] GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:17.394014 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-12a682d8-3937-41cb-b4d2-d984c1f44eec tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:17.402093 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-12a682d8-3937-41cb-b4d2-d984c1f44eec tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1734 microversion: 2.1 time: 0.156512 Jun 01 04:33:17.403316 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 291/575] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:17 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:33:18.073929 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-e40354a8-a54b-4bb2-89ce-f3d7d083dbe7 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:18.075212 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-e40354a8-a54b-4bb2-89ce-f3d7d083dbe7 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:18.077225 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_api:SELECT=58 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:18.081890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e40354a8-a54b-4bb2-89ce-f3d7d083dbe7 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:18.082336 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e40354a8-a54b-4bb2-89ce-f3d7d083dbe7 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:18.083096 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e40354a8-a54b-4bb2-89ce-f3d7d083dbe7 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:18.083555 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e40354a8-a54b-4bb2-89ce-f3d7d083dbe7 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:18.215771 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-e40354a8-a54b-4bb2-89ce-f3d7d083dbe7 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:18.223117 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-e40354a8-a54b-4bb2-89ce-f3d7d083dbe7 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1711 microversion: 2.1 time: 0.153001 Jun 01 04:33:18.223904 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 285/576] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:18 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1711 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:18.290659 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-c79220f4-fe2e-4161-bd0c-7adb446f465c tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:18.291289 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-c79220f4-fe2e-4161-bd0c-7adb446f465c tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: 8cacd474-e05d-4ec8-a35f-c111ca326544] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:18.297909 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c79220f4-fe2e-4161-bd0c-7adb446f465c tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:18.298354 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c79220f4-fe2e-4161-bd0c-7adb446f465c tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:18.299111 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c79220f4-fe2e-4161-bd0c-7adb446f465c tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:18.299579 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c79220f4-fe2e-4161-bd0c-7adb446f465c tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:18.360311 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-c79220f4-fe2e-4161-bd0c-7adb446f465c tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:18.368851 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-c79220f4-fe2e-4161-bd0c-7adb446f465c tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544" status: 200 len: 1271 microversion: 2.1 time: 0.082043 Jun 01 04:33:18.369419 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 292/577] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:18 2022] GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544 => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:18.421563 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-5eb17b08-2660-4f13-a19c-ee543b70b4d5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:18.422084 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-5eb17b08-2660-4f13-a19c-ee543b70b4d5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:18.428257 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5eb17b08-2660-4f13-a19c-ee543b70b4d5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:18.428704 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5eb17b08-2660-4f13-a19c-ee543b70b4d5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:18.429456 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5eb17b08-2660-4f13-a19c-ee543b70b4d5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:18.429887 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5eb17b08-2660-4f13-a19c-ee543b70b4d5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:18.560489 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-5eb17b08-2660-4f13-a19c-ee543b70b4d5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:18.568750 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-5eb17b08-2660-4f13-a19c-ee543b70b4d5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1734 microversion: 2.1 time: 0.151090 Jun 01 04:33:18.569315 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 286/578] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:18 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:19.385852 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-acfaee38-e09b-4d4b-89a0-f1a162a14e33 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:19.386520 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-acfaee38-e09b-4d4b-89a0-f1a162a14e33 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: 8cacd474-e05d-4ec8-a35f-c111ca326544] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:19.393187 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-acfaee38-e09b-4d4b-89a0-f1a162a14e33 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:19.393636 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-acfaee38-e09b-4d4b-89a0-f1a162a14e33 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:19.394393 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-acfaee38-e09b-4d4b-89a0-f1a162a14e33 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:19.394825 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-acfaee38-e09b-4d4b-89a0-f1a162a14e33 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:19.475144 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-acfaee38-e09b-4d4b-89a0-f1a162a14e33 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:19.483083 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-acfaee38-e09b-4d4b-89a0-f1a162a14e33 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544" status: 200 len: 1277 microversion: 2.1 time: 0.101077 Jun 01 04:33:19.483998 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 293/579] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:19 2022] GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544 => generated 1277 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:19.585623 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-1d2566b0-d75e-4f7c-945f-7931a8034321 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:19.586291 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-1d2566b0-d75e-4f7c-945f-7931a8034321 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:19.593557 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1d2566b0-d75e-4f7c-945f-7931a8034321 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:19.594249 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1d2566b0-d75e-4f7c-945f-7931a8034321 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:19.595181 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1d2566b0-d75e-4f7c-945f-7931a8034321 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:19.595635 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1d2566b0-d75e-4f7c-945f-7931a8034321 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:19.598392 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:19.737465 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-1d2566b0-d75e-4f7c-945f-7931a8034321 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:19.745335 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-1d2566b0-d75e-4f7c-945f-7931a8034321 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1734 microversion: 2.1 time: 0.163469 Jun 01 04:33:19.745910 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 287/580] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:19 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:20.500830 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-3957d625-fb3e-4782-afc9-7b9e509a2d11 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:20.501436 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-3957d625-fb3e-4782-afc9-7b9e509a2d11 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: 8cacd474-e05d-4ec8-a35f-c111ca326544] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:20.507953 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3957d625-fb3e-4782-afc9-7b9e509a2d11 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:20.508433 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3957d625-fb3e-4782-afc9-7b9e509a2d11 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:20.509195 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3957d625-fb3e-4782-afc9-7b9e509a2d11 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:20.509627 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3957d625-fb3e-4782-afc9-7b9e509a2d11 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:20.701641 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-3957d625-fb3e-4782-afc9-7b9e509a2d11 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:20.708986 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-3957d625-fb3e-4782-afc9-7b9e509a2d11 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544" status: 200 len: 1319 microversion: 2.1 time: 0.212586 Jun 01 04:33:20.709552 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 294/581] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:20 2022] GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:20.761948 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-8ad97232-a669-4e81-9d85-08ab6d8726b0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:20.762549 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-8ad97232-a669-4e81-9d85-08ab6d8726b0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:20.769048 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8ad97232-a669-4e81-9d85-08ab6d8726b0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:20.769490 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8ad97232-a669-4e81-9d85-08ab6d8726b0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:20.770244 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8ad97232-a669-4e81-9d85-08ab6d8726b0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:20.770677 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8ad97232-a669-4e81-9d85-08ab6d8726b0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:20.888230 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-f168659e-60f1-4f8c-85f1-ae3885dbc44b req-45377e0c-6f2e-4e14-949a-ee8f3262d063 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cacd474-e05d-4ec8-a35f-c111ca326544", "tag": "24bfa69e-b223-4cee-8525-825c7843db5b"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:33:20.896239 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-f168659e-60f1-4f8c-85f1-ae3885dbc44b req-45377e0c-6f2e-4e14-949a-ee8f3262d063 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:20.896679 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-f168659e-60f1-4f8c-85f1-ae3885dbc44b req-45377e0c-6f2e-4e14-949a-ee8f3262d063 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:20.907087 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-8ad97232-a669-4e81-9d85-08ab6d8726b0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:20.907819 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-f168659e-60f1-4f8c-85f1-ae3885dbc44b req-45377e0c-6f2e-4e14-949a-ee8f3262d063 service nova] Creating event network-changed:24bfa69e-b223-4cee-8525-825c7843db5b for instance 8cacd474-e05d-4ec8-a35f-c111ca326544 on hv-cinder-66710 Jun 01 04:33:20.912662 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-f168659e-60f1-4f8c-85f1-ae3885dbc44b req-45377e0c-6f2e-4e14-949a-ee8f3262d063 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091158 Jun 01 04:33:20.913245 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 295/582] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:33:20.917465 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-8ad97232-a669-4e81-9d85-08ab6d8726b0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1734 microversion: 2.1 time: 0.159380 Jun 01 04:33:20.918025 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 288/583] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:20 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:21.727006 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-2d3559a3-b3c3-4330-be10-3d019018c0c9 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:21.727790 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-2d3559a3-b3c3-4330-be10-3d019018c0c9 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: 8cacd474-e05d-4ec8-a35f-c111ca326544] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:21.734721 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2d3559a3-b3c3-4330-be10-3d019018c0c9 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:21.735173 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2d3559a3-b3c3-4330-be10-3d019018c0c9 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:21.735979 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2d3559a3-b3c3-4330-be10-3d019018c0c9 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:21.736414 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2d3559a3-b3c3-4330-be10-3d019018c0c9 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:21.939647 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-24b37ccc-2165-4595-a1e0-c99ec0adb08c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:21.940625 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-24b37ccc-2165-4595-a1e0-c99ec0adb08c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:21.947849 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-2d3559a3-b3c3-4330-be10-3d019018c0c9 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:21.949403 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-24b37ccc-2165-4595-a1e0-c99ec0adb08c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:21.950075 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-24b37ccc-2165-4595-a1e0-c99ec0adb08c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:21.951521 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-24b37ccc-2165-4595-a1e0-c99ec0adb08c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:21.952110 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-24b37ccc-2165-4595-a1e0-c99ec0adb08c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:21.956785 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-2d3559a3-b3c3-4330-be10-3d019018c0c9 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544" status: 200 len: 1319 microversion: 2.1 time: 0.234439 Jun 01 04:33:21.957365 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 296/584] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:21 2022] GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544 => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:22.089037 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-24b37ccc-2165-4595-a1e0-c99ec0adb08c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:22.097237 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-24b37ccc-2165-4595-a1e0-c99ec0adb08c tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1734 microversion: 2.1 time: 0.166063 Jun 01 04:33:22.097799 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 289/585] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:21 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:33:22.974456 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-e7f134c4-66be-459e-bf13-0ba48e8a8826 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:22.975016 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-e7f134c4-66be-459e-bf13-0ba48e8a8826 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: 8cacd474-e05d-4ec8-a35f-c111ca326544] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:22.981494 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e7f134c4-66be-459e-bf13-0ba48e8a8826 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:22.981956 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e7f134c4-66be-459e-bf13-0ba48e8a8826 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:22.982722 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e7f134c4-66be-459e-bf13-0ba48e8a8826 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:22.983163 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e7f134c4-66be-459e-bf13-0ba48e8a8826 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:23.110281 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-e7f134c4-66be-459e-bf13-0ba48e8a8826 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:23.114113 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-0c5c6260-2848-4399-8169-f358f45eecf1 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:23.114871 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-0c5c6260-2848-4399-8169-f358f45eecf1 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:23.118620 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-e7f134c4-66be-459e-bf13-0ba48e8a8826 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544" status: 200 len: 1319 microversion: 2.1 time: 0.148105 Jun 01 04:33:23.119195 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 297/586] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:22 2022] GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:23.121274 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0c5c6260-2848-4399-8169-f358f45eecf1 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:23.121717 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0c5c6260-2848-4399-8169-f358f45eecf1 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:23.122483 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0c5c6260-2848-4399-8169-f358f45eecf1 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:23.122912 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0c5c6260-2848-4399-8169-f358f45eecf1 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:23.257373 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-0c5c6260-2848-4399-8169-f358f45eecf1 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:23.265866 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-0c5c6260-2848-4399-8169-f358f45eecf1 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1734 microversion: 2.1 time: 0.155840 Jun 01 04:33:23.266481 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 290/587] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:23 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:33:24.136123 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-27cac37f-99e1-4128-a359-7e6095886499 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:24.137012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-27cac37f-99e1-4128-a359-7e6095886499 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: 8cacd474-e05d-4ec8-a35f-c111ca326544] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:24.145119 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-27cac37f-99e1-4128-a359-7e6095886499 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:24.145597 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-27cac37f-99e1-4128-a359-7e6095886499 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:24.146415 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-27cac37f-99e1-4128-a359-7e6095886499 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:24.146857 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-27cac37f-99e1-4128-a359-7e6095886499 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:24.287086 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-ce49a6b4-a6c7-4e0f-880d-486af3129c35 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:24.287086 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-ce49a6b4-a6c7-4e0f-880d-486af3129c35 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:24.287703 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-27cac37f-99e1-4128-a359-7e6095886499 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:24.292581 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ce49a6b4-a6c7-4e0f-880d-486af3129c35 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:24.293030 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ce49a6b4-a6c7-4e0f-880d-486af3129c35 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:24.293814 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ce49a6b4-a6c7-4e0f-880d-486af3129c35 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:24.294286 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ce49a6b4-a6c7-4e0f-880d-486af3129c35 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:24.295580 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-27cac37f-99e1-4128-a359-7e6095886499 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544" status: 200 len: 1319 microversion: 2.1 time: 0.163161 Jun 01 04:33:24.297598 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 298/588] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:24 2022] GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:24.436372 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-ce49a6b4-a6c7-4e0f-880d-486af3129c35 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:24.444339 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-ce49a6b4-a6c7-4e0f-880d-486af3129c35 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1714 microversion: 2.1 time: 0.164486 Jun 01 04:33:24.444902 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 291/589] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:24 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1714 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:33:24.498773 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-df47b0b3-c3db-454d-99f3-4c1c63abd89f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:24.499269 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-df47b0b3-c3db-454d-99f3-4c1c63abd89f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:24.505312 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-df47b0b3-c3db-454d-99f3-4c1c63abd89f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:24.505753 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-df47b0b3-c3db-454d-99f3-4c1c63abd89f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:24.506508 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-df47b0b3-c3db-454d-99f3-4c1c63abd89f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:24.506938 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-df47b0b3-c3db-454d-99f3-4c1c63abd89f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:24.634404 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.wsgi [None req-df47b0b3-c3db-454d-99f3-4c1c63abd89f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] HTTP exception thrown: Cannot 'detach_volume' instance 9f8eae96-794e-4cdb-a397-0f892e3fd9f0 while it is in vm_state rescued Jun 01 04:33:24.636044 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-df47b0b3-c3db-454d-99f3-4c1c63abd89f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Request method failure captured: Jun 01 04:33:24.636044 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: request: DELETE /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0/os-volume_attachments/bf7c57d1-aa77-44dc-a43c-c9f656433a61 HTTP/1.1 Jun 01 04:33:24.636044 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept: application/json Jun 01 04:33:24.636044 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept-Encoding: identity Jun 01 04:33:24.636044 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Connection: close Jun 01 04:33:24.636044 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Length: 0 Jun 01 04:33:24.636044 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Type: application/json Jun 01 04:33:24.636044 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Host: 10.222.0.18 Jun 01 04:33:24.636044 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Openstack-System-Scope: None Jun 01 04:33:24.636044 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: User-Agent: python-urllib3/1.26.9 Jun 01 04:33:24.636044 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Auth-Token: gAAAAABiluq6EdglhZgXiS3poHNwL1UUlx7ueC5joJlWhxd9bYUqBcVhkRgghCVJtLC4e0wLqyaT33kVSWKLZMbzDI4PfCEcbl3WeLPmp8XhZ65e-9_afNsqAcBGQuzFEA_cFCtrXjwsuFGgJBYRijSPhwsG4KkGPRwDtmJAygQq6VRDVmLA8kk Jun 01 04:33:24.636044 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Id: None Jun 01 04:33:24.636044 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Name: None Jun 01 04:33:24.636044 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Identity-Status: Confirmed Jun 01 04:33:24.636044 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Is-Admin-Project: True Jun 01 04:33:24.636044 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Id: default Jun 01 04:33:24.636044 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Name: Default Jun 01 04:33:24.636044 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Id: bda53dca70e54e208b2767a833923234 Jun 01 04:33:24.636044 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-788108745 Jun 01 04:33:24.636044 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Role: reader,member Jun 01 04:33:24.636044 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Roles: reader,member Jun 01 04:33:24.637614 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bda53dca70e54e208b2767a833923234"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bda53dca70e54e208b2767a833923234"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bda53dca70e54e208b2767a833923234"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bda53dca70e54e208b2767a833923234"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:33:24.637614 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant: tempest-ServerRescueNegativeTestJSON-788108745 Jun 01 04:33:24.637614 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Id: bda53dca70e54e208b2767a833923234 Jun 01 04:33:24.637614 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-788108745 Jun 01 04:33:24.637614 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User: tempest-ServerRescueNegativeTestJSON-788108745-project Jun 01 04:33:24.637614 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Id: default Jun 01 04:33:24.637614 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Name: Default Jun 01 04:33:24.637614 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Id: 12816eca659542af9e41b92fdb674eab Jun 01 04:33:24.637614 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Name: tempest-ServerRescueNegativeTestJSON-788108745-project Jun 01 04:33:24.637614 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: method: > Jun 01 04:33:24.637614 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: exception: Cannot 'detach_volume' instance 9f8eae96-794e-4cdb-a397-0f892e3fd9f0 while it is in vm_state rescued Jun 01 04:33:24.638460 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: action_args: {'server_id': '9f8eae96-794e-4cdb-a397-0f892e3fd9f0', 'id': 'bf7c57d1-aa77-44dc-a43c-c9f656433a61'} Jun 01 04:33:24.638460 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:33:24.638460 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:33:24.638460 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 01 04:33:24.638460 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 01 04:33:24.638460 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 01 04:33:24.638460 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 01 04:33:24.638460 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 01 04:33:24.638460 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 01 04:33:24.638460 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9f8eae96-794e-4cdb-a397-0f892e3fd9f0 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 01 04:33:24.638460 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:33:24.638460 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:33:24.638460 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:33:24.638460 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:33:24.638460 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:33:24.638460 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:33:24.638460 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:33:24.638460 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:33:24.638460 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:33:24.638460 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:33:24.640709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 01 04:33:24.640709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 01 04:33:24.640709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 01 04:33:24.640709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 01 04:33:24.640709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 9f8eae96-794e-4cdb-a397-0f892e3fd9f0 while it is in vm_state rescued Jun 01 04:33:24.640709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:33:24.640709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:33:24.640709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:33:24.640709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:33:24.640709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:33:24.640709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:33:24.640709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:33:24.640709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:33:24.640709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 9f8eae96-794e-4cdb-a397-0f892e3fd9f0 while it is in vm_state rescued Jun 01 04:33:24.640709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:33:24.640709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-df47b0b3-c3db-454d-99f3-4c1c63abd89f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Returning 409 to user: Cannot 'detach_volume' instance 9f8eae96-794e-4cdb-a397-0f892e3fd9f0 while it is in vm_state rescued {{(pid=118516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:33:24.641931 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-df47b0b3-c3db-454d-99f3-4c1c63abd89f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0/os-volume_attachments/bf7c57d1-aa77-44dc-a43c-c9f656433a61" status: 409 len: 152 microversion: 2.1 time: 0.143346 Jun 01 04:33:24.641931 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 299/590] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 1 04:33:24 2022] DELETE /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0/os-volume_attachments/bf7c57d1-aa77-44dc-a43c-c9f656433a61 => generated 152 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 01 04:33:24.647564 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-76d05cd3-22bc-45e0-837f-96b46303f0f9 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:33:24.648094 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-76d05cd3-22bc-45e0-837f-96b46303f0f9 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:24.658584 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-76d05cd3-22bc-45e0-837f-96b46303f0f9 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:24.659032 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-76d05cd3-22bc-45e0-837f-96b46303f0f9 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:24.659881 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-76d05cd3-22bc-45e0-837f-96b46303f0f9 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:24.660317 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-76d05cd3-22bc-45e0-837f-96b46303f0f9 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:24.879883 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-76d05cd3-22bc-45e0-837f-96b46303f0f9 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "POST /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0/action" status: 202 len: 0 microversion: 2.1 time: 0.236008 Jun 01 04:33:24.880522 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 292/591] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 1 04:33:24 2022] POST /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 01 04:33:24.889262 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-8457de2b-94fc-4c3c-88d8-b3f4732bb0b7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:24.889964 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-8457de2b-94fc-4c3c-88d8-b3f4732bb0b7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:24.899862 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8457de2b-94fc-4c3c-88d8-b3f4732bb0b7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:24.900312 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8457de2b-94fc-4c3c-88d8-b3f4732bb0b7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:24.901089 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8457de2b-94fc-4c3c-88d8-b3f4732bb0b7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:24.901529 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8457de2b-94fc-4c3c-88d8-b3f4732bb0b7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:25.034330 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-8457de2b-94fc-4c3c-88d8-b3f4732bb0b7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:25.042425 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-8457de2b-94fc-4c3c-88d8-b3f4732bb0b7 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1722 microversion: 2.1 time: 0.157399 Jun 01 04:33:25.042984 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 300/592] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:24 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:33:25.314183 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-6920ed2d-bee9-4634-add8-65582e0316a7 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:25.314843 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-6920ed2d-bee9-4634-add8-65582e0316a7 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: 8cacd474-e05d-4ec8-a35f-c111ca326544] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:25.321241 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6920ed2d-bee9-4634-add8-65582e0316a7 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:25.329326 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6920ed2d-bee9-4634-add8-65582e0316a7 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:25.329326 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6920ed2d-bee9-4634-add8-65582e0316a7 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:25.329326 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6920ed2d-bee9-4634-add8-65582e0316a7 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:25.464154 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-6920ed2d-bee9-4634-add8-65582e0316a7 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:25.472376 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-6920ed2d-bee9-4634-add8-65582e0316a7 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544" status: 200 len: 1319 microversion: 2.1 time: 0.162916 Jun 01 04:33:25.472948 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 293/593] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:25 2022] GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:26.061425 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-56003555-d3cd-4c06-82c0-78bbed56c74f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:26.062063 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-56003555-d3cd-4c06-82c0-78bbed56c74f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:26.064560 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell0:SELECT=2 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:26.069833 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-56003555-d3cd-4c06-82c0-78bbed56c74f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:26.070284 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-56003555-d3cd-4c06-82c0-78bbed56c74f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:26.071053 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-56003555-d3cd-4c06-82c0-78bbed56c74f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:26.071519 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-56003555-d3cd-4c06-82c0-78bbed56c74f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:26.172888 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell0:SELECT=8 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:26.199127 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-56003555-d3cd-4c06-82c0-78bbed56c74f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:26.207571 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-56003555-d3cd-4c06-82c0-78bbed56c74f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1722 microversion: 2.1 time: 0.150555 Jun 01 04:33:26.208135 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 301/594] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:26 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:26.489484 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-9af1f645-51c2-49ac-bb65-ff453103cf06 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:26.490083 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-9af1f645-51c2-49ac-bb65-ff453103cf06 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: 8cacd474-e05d-4ec8-a35f-c111ca326544] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:26.496595 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9af1f645-51c2-49ac-bb65-ff453103cf06 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:26.497034 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9af1f645-51c2-49ac-bb65-ff453103cf06 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:26.497780 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9af1f645-51c2-49ac-bb65-ff453103cf06 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:26.498816 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9af1f645-51c2-49ac-bb65-ff453103cf06 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:26.628035 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-9af1f645-51c2-49ac-bb65-ff453103cf06 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:26.634685 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-9af1f645-51c2-49ac-bb65-ff453103cf06 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544" status: 200 len: 1319 microversion: 2.1 time: 0.149304 Jun 01 04:33:26.635248 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 294/595] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:26 2022] GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:27.225220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d8cdcaf7-b855-4225-a54a-61a637df4746 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:27.226065 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-d8cdcaf7-b855-4225-a54a-61a637df4746 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:27.232763 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d8cdcaf7-b855-4225-a54a-61a637df4746 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:27.233216 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d8cdcaf7-b855-4225-a54a-61a637df4746 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:27.233993 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d8cdcaf7-b855-4225-a54a-61a637df4746 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:27.234425 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d8cdcaf7-b855-4225-a54a-61a637df4746 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:27.428563 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-d8cdcaf7-b855-4225-a54a-61a637df4746 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:27.448249 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-d8cdcaf7-b855-4225-a54a-61a637df4746 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1722 microversion: 2.1 time: 0.227345 Jun 01 04:33:27.448844 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 302/596] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:27 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:33:27.651261 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-1d9a79c3-9576-4b45-9148-c8cc218254c1 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:27.651898 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-1d9a79c3-9576-4b45-9148-c8cc218254c1 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: 8cacd474-e05d-4ec8-a35f-c111ca326544] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:27.661537 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1d9a79c3-9576-4b45-9148-c8cc218254c1 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:27.662097 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1d9a79c3-9576-4b45-9148-c8cc218254c1 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:27.662755 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1d9a79c3-9576-4b45-9148-c8cc218254c1 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:27.663190 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1d9a79c3-9576-4b45-9148-c8cc218254c1 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:27.803564 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-1d9a79c3-9576-4b45-9148-c8cc218254c1 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:27.811999 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-1d9a79c3-9576-4b45-9148-c8cc218254c1 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544" status: 200 len: 1319 microversion: 2.1 time: 0.164490 Jun 01 04:33:27.812578 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 295/597] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:27 2022] GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:28.465670 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-8a97126d-c19b-4e2e-a373-87880fb442d1 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:28.466285 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-8a97126d-c19b-4e2e-a373-87880fb442d1 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:28.473458 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8a97126d-c19b-4e2e-a373-87880fb442d1 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:28.473913 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8a97126d-c19b-4e2e-a373-87880fb442d1 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:28.474678 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8a97126d-c19b-4e2e-a373-87880fb442d1 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:28.475116 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8a97126d-c19b-4e2e-a373-87880fb442d1 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:28.609583 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-8a97126d-c19b-4e2e-a373-87880fb442d1 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:28.619684 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-8a97126d-c19b-4e2e-a373-87880fb442d1 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1722 microversion: 2.1 time: 0.157916 Jun 01 04:33:28.620487 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 303/598] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:28 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:28.829719 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-df1ab295-01a7-4bac-9af4-f0f2abf6dd46 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:28.830335 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-df1ab295-01a7-4bac-9af4-f0f2abf6dd46 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: 8cacd474-e05d-4ec8-a35f-c111ca326544] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:28.836813 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-df1ab295-01a7-4bac-9af4-f0f2abf6dd46 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:28.837268 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-df1ab295-01a7-4bac-9af4-f0f2abf6dd46 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:28.838041 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-df1ab295-01a7-4bac-9af4-f0f2abf6dd46 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:28.838477 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-df1ab295-01a7-4bac-9af4-f0f2abf6dd46 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:28.967484 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-df1ab295-01a7-4bac-9af4-f0f2abf6dd46 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:28.975115 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-df1ab295-01a7-4bac-9af4-f0f2abf6dd46 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544" status: 200 len: 1319 microversion: 2.1 time: 0.149839 Jun 01 04:33:28.975660 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 296/599] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:28 2022] GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:29.636710 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-51e1cc2a-f51e-464e-96d8-7d555de92a90 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:29.637319 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-51e1cc2a-f51e-464e-96d8-7d555de92a90 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:29.644724 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-51e1cc2a-f51e-464e-96d8-7d555de92a90 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:29.645173 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-51e1cc2a-f51e-464e-96d8-7d555de92a90 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:29.645926 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-51e1cc2a-f51e-464e-96d8-7d555de92a90 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:29.646358 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-51e1cc2a-f51e-464e-96d8-7d555de92a90 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:29.785251 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-51e1cc2a-f51e-464e-96d8-7d555de92a90 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:29.793067 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-51e1cc2a-f51e-464e-96d8-7d555de92a90 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1722 microversion: 2.1 time: 0.160180 Jun 01 04:33:29.793619 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 304/600] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:29 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:29.991976 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-31e35b83-8c35-4c35-8481-aae505bdb19c tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:29.992490 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-31e35b83-8c35-4c35-8481-aae505bdb19c tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: 8cacd474-e05d-4ec8-a35f-c111ca326544] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:29.999723 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-31e35b83-8c35-4c35-8481-aae505bdb19c tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:30.009532 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-31e35b83-8c35-4c35-8481-aae505bdb19c tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:30.009532 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-31e35b83-8c35-4c35-8481-aae505bdb19c tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:30.009532 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-31e35b83-8c35-4c35-8481-aae505bdb19c tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:30.129084 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-31e35b83-8c35-4c35-8481-aae505bdb19c tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:30.136424 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-31e35b83-8c35-4c35-8481-aae505bdb19c tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544" status: 200 len: 1319 microversion: 2.1 time: 0.148361 Jun 01 04:33:30.136978 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 297/601] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:29 2022] GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:30.810239 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-0bd643ba-d5e5-45bd-9398-584b674e907f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:30.815655 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-0bd643ba-d5e5-45bd-9398-584b674e907f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:30.817430 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0bd643ba-d5e5-45bd-9398-584b674e907f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:30.817888 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0bd643ba-d5e5-45bd-9398-584b674e907f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:30.818656 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0bd643ba-d5e5-45bd-9398-584b674e907f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:30.819099 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0bd643ba-d5e5-45bd-9398-584b674e907f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:30.948230 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-0bd643ba-d5e5-45bd-9398-584b674e907f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:30.956774 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-0bd643ba-d5e5-45bd-9398-584b674e907f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1722 microversion: 2.1 time: 0.150476 Jun 01 04:33:30.957339 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 305/602] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:30 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:31.117416 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-56cb01b8-8a50-4cfd-930d-d30213f4929b req-f75a543f-2fca-4e94-9be8-7b2134d7b317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cacd474-e05d-4ec8-a35f-c111ca326544", "name": "network-vif-plugged", "status": "completed", "tag": "24bfa69e-b223-4cee-8525-825c7843db5b"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:33:31.125368 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-56cb01b8-8a50-4cfd-930d-d30213f4929b req-f75a543f-2fca-4e94-9be8-7b2134d7b317 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:31.125952 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-56cb01b8-8a50-4cfd-930d-d30213f4929b req-f75a543f-2fca-4e94-9be8-7b2134d7b317 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:31.146303 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-56cb01b8-8a50-4cfd-930d-d30213f4929b req-f75a543f-2fca-4e94-9be8-7b2134d7b317 service nova] Creating event network-vif-plugged:24bfa69e-b223-4cee-8525-825c7843db5b for instance 8cacd474-e05d-4ec8-a35f-c111ca326544 on hv-cinder-66710 Jun 01 04:33:31.146303 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-56cb01b8-8a50-4cfd-930d-d30213f4929b req-f75a543f-2fca-4e94-9be8-7b2134d7b317 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083082 Jun 01 04:33:31.146303 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 298/603] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:33:31.153692 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-9612c162-e816-4374-9d3c-bef4c475f8d4 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:31.154817 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-9612c162-e816-4374-9d3c-bef4c475f8d4 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: 8cacd474-e05d-4ec8-a35f-c111ca326544] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:31.161017 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9612c162-e816-4374-9d3c-bef4c475f8d4 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:31.161329 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9612c162-e816-4374-9d3c-bef4c475f8d4 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:31.162091 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9612c162-e816-4374-9d3c-bef4c475f8d4 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:31.162528 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9612c162-e816-4374-9d3c-bef4c475f8d4 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:31.166459 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=100 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:31.298343 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-9612c162-e816-4374-9d3c-bef4c475f8d4 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:31.305918 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-9612c162-e816-4374-9d3c-bef4c475f8d4 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544" status: 200 len: 1319 microversion: 2.1 time: 0.155919 Jun 01 04:33:31.310158 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 306/604] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:31 2022] GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:31.974505 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a4843193-ca9b-490f-9af9-e331c4074666 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:31.975120 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-a4843193-ca9b-490f-9af9-e331c4074666 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:31.981317 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a4843193-ca9b-490f-9af9-e331c4074666 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:31.981768 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a4843193-ca9b-490f-9af9-e331c4074666 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:31.982531 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a4843193-ca9b-490f-9af9-e331c4074666 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:31.982969 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a4843193-ca9b-490f-9af9-e331c4074666 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:32.113804 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-a4843193-ca9b-490f-9af9-e331c4074666 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:32.121875 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-a4843193-ca9b-490f-9af9-e331c4074666 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1728 microversion: 2.1 time: 0.151599 Jun 01 04:33:32.122501 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 299/605] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:31 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:32.138557 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d6cb7bb2-d7c3-4525-8155-ac7d82a8938a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:32.139713 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-d6cb7bb2-d7c3-4525-8155-ac7d82a8938a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:32.146530 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d6cb7bb2-d7c3-4525-8155-ac7d82a8938a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:32.146980 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d6cb7bb2-d7c3-4525-8155-ac7d82a8938a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:32.147774 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d6cb7bb2-d7c3-4525-8155-ac7d82a8938a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:32.148214 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d6cb7bb2-d7c3-4525-8155-ac7d82a8938a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:32.223671 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-d6cb7bb2-d7c3-4525-8155-ac7d82a8938a tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088892 Jun 01 04:33:32.224258 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 307/606] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Jun 1 04:33:32 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:33:32.323380 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-092f6b4b-f28b-4cfb-8720-a263c2615729 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:32.323988 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-092f6b4b-f28b-4cfb-8720-a263c2615729 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: 8cacd474-e05d-4ec8-a35f-c111ca326544] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:32.329950 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-092f6b4b-f28b-4cfb-8720-a263c2615729 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:32.330399 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-092f6b4b-f28b-4cfb-8720-a263c2615729 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:32.331162 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-092f6b4b-f28b-4cfb-8720-a263c2615729 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:32.331615 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-092f6b4b-f28b-4cfb-8720-a263c2615729 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:32.459642 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-092f6b4b-f28b-4cfb-8720-a263c2615729 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:32.467044 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-092f6b4b-f28b-4cfb-8720-a263c2615729 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544" status: 200 len: 1319 microversion: 2.1 time: 0.147456 Jun 01 04:33:32.467637 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 300/607] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:32 2022] GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:33.130293 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-3453c2eb-2f41-42de-8f45-3d5cbc80cf3e req-d12b4027-44ca-40f1-a064-8ebe93b07290 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f8eae96-794e-4cdb-a397-0f892e3fd9f0", "tag": "ca205306-46cb-4b2c-ad84-b2f690075069"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:33:33.138547 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-3453c2eb-2f41-42de-8f45-3d5cbc80cf3e req-d12b4027-44ca-40f1-a064-8ebe93b07290 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:33.139766 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-3453c2eb-2f41-42de-8f45-3d5cbc80cf3e req-d12b4027-44ca-40f1-a064-8ebe93b07290 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:33.151787 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-3453c2eb-2f41-42de-8f45-3d5cbc80cf3e req-d12b4027-44ca-40f1-a064-8ebe93b07290 service nova] Creating event network-changed:ca205306-46cb-4b2c-ad84-b2f690075069 for instance 9f8eae96-794e-4cdb-a397-0f892e3fd9f0 on hv-cinder-66710 Jun 01 04:33:33.160548 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-3453c2eb-2f41-42de-8f45-3d5cbc80cf3e req-d12b4027-44ca-40f1-a064-8ebe93b07290 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034064 Jun 01 04:33:33.161433 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 308/608] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:33:33.484321 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-1e868e22-0e7c-4a1b-94ff-4fc49399485a tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:33.484929 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-1e868e22-0e7c-4a1b-94ff-4fc49399485a tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: 8cacd474-e05d-4ec8-a35f-c111ca326544] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:33.491674 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1e868e22-0e7c-4a1b-94ff-4fc49399485a tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:33.492129 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1e868e22-0e7c-4a1b-94ff-4fc49399485a tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:33.492899 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1e868e22-0e7c-4a1b-94ff-4fc49399485a tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:33.493338 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1e868e22-0e7c-4a1b-94ff-4fc49399485a tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:33.632441 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-1e868e22-0e7c-4a1b-94ff-4fc49399485a tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:33.640830 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-1e868e22-0e7c-4a1b-94ff-4fc49399485a tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544" status: 200 len: 1319 microversion: 2.1 time: 0.160284 Jun 01 04:33:33.641409 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 301/609] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:33 2022] GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:34.659571 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-35e7066b-ce1e-401a-b12d-4d4543e3c73d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:33:34.664059 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-35e7066b-ce1e-401a-b12d-4d4543e3c73d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: 8cacd474-e05d-4ec8-a35f-c111ca326544] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:34.667164 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-35e7066b-ce1e-401a-b12d-4d4543e3c73d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:34.667661 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-35e7066b-ce1e-401a-b12d-4d4543e3c73d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:34.668429 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-35e7066b-ce1e-401a-b12d-4d4543e3c73d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:34.668960 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-35e7066b-ce1e-401a-b12d-4d4543e3c73d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:34.799458 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-35e7066b-ce1e-401a-b12d-4d4543e3c73d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:33:34.807183 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-35e7066b-ce1e-401a-b12d-4d4543e3c73d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544" status: 200 len: 1508 microversion: 2.1 time: 0.152986 Jun 01 04:33:34.807790 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 309/610] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:33:34 2022] GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:33:34.826735 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-e3d5ecf0-9237-4a9d-9e57-8ad30384773d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "218db449-f816-4a5d-a6b8-9f4f1405910c", "device": "/dev/sdb"}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:33:34.828561 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-e3d5ecf0-9237-4a9d-9e57-8ad30384773d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: 8cacd474-e05d-4ec8-a35f-c111ca326544] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:33:34.836346 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e3d5ecf0-9237-4a9d-9e57-8ad30384773d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:34.836793 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e3d5ecf0-9237-4a9d-9e57-8ad30384773d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:34.837560 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e3d5ecf0-9237-4a9d-9e57-8ad30384773d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:34.837988 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e3d5ecf0-9237-4a9d-9e57-8ad30384773d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:35.059932 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:35.355532 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-9560db94-6c12-409e-9a92-0ccf95018fb3 req-4be3df43-835d-47d8-8f85-27ac964f7de9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f8eae96-794e-4cdb-a397-0f892e3fd9f0", "tag": "ca205306-46cb-4b2c-ad84-b2f690075069"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:33:35.364921 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-9560db94-6c12-409e-9a92-0ccf95018fb3 req-4be3df43-835d-47d8-8f85-27ac964f7de9 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:33:35.365367 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-9560db94-6c12-409e-9a92-0ccf95018fb3 req-4be3df43-835d-47d8-8f85-27ac964f7de9 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:33:35.378426 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-9560db94-6c12-409e-9a92-0ccf95018fb3 req-4be3df43-835d-47d8-8f85-27ac964f7de9 service nova] Creating event network-changed:ca205306-46cb-4b2c-ad84-b2f690075069 for instance 9f8eae96-794e-4cdb-a397-0f892e3fd9f0 on hv-cinder-66710 Jun 01 04:33:35.383424 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-9560db94-6c12-409e-9a92-0ccf95018fb3 req-4be3df43-835d-47d8-8f85-27ac964f7de9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031554 Jun 01 04:33:35.384275 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 310/611] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:33:35.600430 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-e3d5ecf0-9237-4a9d-9e57-8ad30384773d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "POST /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.778121 Jun 01 04:33:35.601301 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 302/612] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 1 04:33:34 2022] POST /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544/os-volume_attachments => generated 194 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:34:00.655230 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:00.656012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=18 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:00.660204 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-92fd118e-d001-4350-986e-1c1e0ff3581f tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:00.662434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-92fd118e-d001-4350-986e-1c1e0ff3581f tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: 8cacd474-e05d-4ec8-a35f-c111ca326544] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:00.666817 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-92fd118e-d001-4350-986e-1c1e0ff3581f tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:00.667270 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-92fd118e-d001-4350-986e-1c1e0ff3581f tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:00.668126 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-92fd118e-d001-4350-986e-1c1e0ff3581f tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:00.668573 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-92fd118e-d001-4350-986e-1c1e0ff3581f tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:00.751370 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.objects.instance [None req-92fd118e-d001-4350-986e-1c1e0ff3581f tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lazy-loading 'services' on Instance uuid 8cacd474-e05d-4ec8-a35f-c111ca326544 {{(pid=118516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:34:01.027764 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-92fd118e-d001-4350-986e-1c1e0ff3581f tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544/os-volume_attachments/218db449-f816-4a5d-a6b8-9f4f1405910c" status: 202 len: 0 microversion: 2.1 time: 0.373832 Jun 01 04:34:01.028378 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 311/613] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 1 04:34:00 2022] DELETE /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544/os-volume_attachments/218db449-f816-4a5d-a6b8-9f4f1405910c => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 01 04:34:01.057867 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 01 04:34:01.060299 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Wed Jun 1 04:34:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 01 04:34:03.191113 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a9089280-3b3d-4c74-bbdb-0c6cf01bd368 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:03.191777 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-a9089280-3b3d-4c74-bbdb-0c6cf01bd368 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: 8cacd474-e05d-4ec8-a35f-c111ca326544] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:03.194236 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_api:SELECT=35 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:03.195014 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=3,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:03.200665 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a9089280-3b3d-4c74-bbdb-0c6cf01bd368 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:03.201109 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a9089280-3b3d-4c74-bbdb-0c6cf01bd368 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:03.201928 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a9089280-3b3d-4c74-bbdb-0c6cf01bd368 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:03.202383 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a9089280-3b3d-4c74-bbdb-0c6cf01bd368 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:03.228148 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-a9089280-3b3d-4c74-bbdb-0c6cf01bd368 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: 8cacd474-e05d-4ec8-a35f-c111ca326544] Going to try to terminate instance {{(pid=118517) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 01 04:34:03.579938 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-a9089280-3b3d-4c74-bbdb-0c6cf01bd368 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544" status: 204 len: 0 microversion: 2.1 time: 0.392664 Jun 01 04:34:03.580525 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 303/614] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 1 04:34:03 2022] DELETE /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 01 04:34:03.589560 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-dbc36efc-ae2f-46fa-a5af-1ef4750a8af4 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:03.590257 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-dbc36efc-ae2f-46fa-a5af-1ef4750a8af4 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: 8cacd474-e05d-4ec8-a35f-c111ca326544] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:03.596527 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-dbc36efc-ae2f-46fa-a5af-1ef4750a8af4 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:03.599804 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-dbc36efc-ae2f-46fa-a5af-1ef4750a8af4 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:03.599804 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-dbc36efc-ae2f-46fa-a5af-1ef4750a8af4 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:03.599804 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-dbc36efc-ae2f-46fa-a5af-1ef4750a8af4 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:03.734999 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-dbc36efc-ae2f-46fa-a5af-1ef4750a8af4 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:03.743206 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-dbc36efc-ae2f-46fa-a5af-1ef4750a8af4 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544" status: 200 len: 1514 microversion: 2.1 time: 0.158258 Jun 01 04:34:03.743804 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 312/615] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:34:03 2022] GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:34:04.763906 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-3d2420a3-469d-415d-8ced-f540d584b5c0 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:04.764681 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-3d2420a3-469d-415d-8ced-f540d584b5c0 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: 8cacd474-e05d-4ec8-a35f-c111ca326544] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:04.771530 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3d2420a3-469d-415d-8ced-f540d584b5c0 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:04.771988 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3d2420a3-469d-415d-8ced-f540d584b5c0 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:04.772761 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3d2420a3-469d-415d-8ced-f540d584b5c0 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:04.773193 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3d2420a3-469d-415d-8ced-f540d584b5c0 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:04.908956 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-3d2420a3-469d-415d-8ced-f540d584b5c0 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:04.916769 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-3d2420a3-469d-415d-8ced-f540d584b5c0 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544" status: 200 len: 1514 microversion: 2.1 time: 0.158239 Jun 01 04:34:04.917336 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 304/616] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:34:04 2022] GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:34:05.934004 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-a16f7497-5972-4714-bce3-91be5a83ed03 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:05.934584 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-a16f7497-5972-4714-bce3-91be5a83ed03 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: 8cacd474-e05d-4ec8-a35f-c111ca326544] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:05.940717 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a16f7497-5972-4714-bce3-91be5a83ed03 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:05.941174 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a16f7497-5972-4714-bce3-91be5a83ed03 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:05.941941 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a16f7497-5972-4714-bce3-91be5a83ed03 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:05.942379 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a16f7497-5972-4714-bce3-91be5a83ed03 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:06.099320 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-a16f7497-5972-4714-bce3-91be5a83ed03 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:06.108763 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-a16f7497-5972-4714-bce3-91be5a83ed03 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544" status: 200 len: 1514 microversion: 2.1 time: 0.178596 Jun 01 04:34:06.109602 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 313/617] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:34:05 2022] GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544 => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:34:06.168070 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-bbb3bd24-68d0-4741-b1da-28f327cb40ab req-e949d0ba-393f-4670-a97c-6721e60c9fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cacd474-e05d-4ec8-a35f-c111ca326544", "name": "network-vif-deleted", "tag": "24bfa69e-b223-4cee-8525-825c7843db5b"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:34:06.176824 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-bbb3bd24-68d0-4741-b1da-28f327cb40ab req-e949d0ba-393f-4670-a97c-6721e60c9fd3 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:06.184298 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-bbb3bd24-68d0-4741-b1da-28f327cb40ab req-e949d0ba-393f-4670-a97c-6721e60c9fd3 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:06.190103 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-bbb3bd24-68d0-4741-b1da-28f327cb40ab req-e949d0ba-393f-4670-a97c-6721e60c9fd3 service nova] Creating event network-vif-deleted:24bfa69e-b223-4cee-8525-825c7843db5b for instance 8cacd474-e05d-4ec8-a35f-c111ca326544 on hv-cinder-66710 Jun 01 04:34:06.194866 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-bbb3bd24-68d0-4741-b1da-28f327cb40ab req-e949d0ba-393f-4670-a97c-6721e60c9fd3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030411 Jun 01 04:34:06.195481 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 305/618] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:34:07.126457 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-2911e2d9-b24b-4c4c-a611-01412b2c2647 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:07.127069 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-2911e2d9-b24b-4c4c-a611-01412b2c2647 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: 8cacd474-e05d-4ec8-a35f-c111ca326544] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:07.134033 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2911e2d9-b24b-4c4c-a611-01412b2c2647 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:07.134490 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2911e2d9-b24b-4c4c-a611-01412b2c2647 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:07.135328 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2911e2d9-b24b-4c4c-a611-01412b2c2647 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:07.135764 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2911e2d9-b24b-4c4c-a611-01412b2c2647 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:07.169149 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2911e2d9-b24b-4c4c-a611-01412b2c2647 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:07.169601 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2911e2d9-b24b-4c4c-a611-01412b2c2647 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:07.170084 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.objects.instance [None req-2911e2d9-b24b-4c4c-a611-01412b2c2647 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lazy-loading 'fault' on Instance uuid 8cacd474-e05d-4ec8-a35f-c111ca326544 {{(pid=118516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:34:07.214690 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-2911e2d9-b24b-4c4c-a611-01412b2c2647 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e249c6bada9d4dcb91b83a0a29ad552d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7454aaeeba6b4a8c86a0446ae68dd4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:07.222294 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-2911e2d9-b24b-4c4c-a611-01412b2c2647 tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544" status: 200 len: 1309 microversion: 2.1 time: 0.100224 Jun 01 04:34:07.222857 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 314/619] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:34:07 2022] GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544 => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:34:08.241404 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-b6f9702b-4334-497a-8173-b9c21f64e16d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:08.242155 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-b6f9702b-4334-497a-8173-b9c21f64e16d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] [instance: 8cacd474-e05d-4ec8-a35f-c111ca326544] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:08.248512 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b6f9702b-4334-497a-8173-b9c21f64e16d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:08.248969 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b6f9702b-4334-497a-8173-b9c21f64e16d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:08.249738 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b6f9702b-4334-497a-8173-b9c21f64e16d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:08.250871 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b6f9702b-4334-497a-8173-b9c21f64e16d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:08.263915 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.wsgi [None req-b6f9702b-4334-497a-8173-b9c21f64e16d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] HTTP exception thrown: Instance 8cacd474-e05d-4ec8-a35f-c111ca326544 could not be found. Jun 01 04:34:08.265526 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-b6f9702b-4334-497a-8173-b9c21f64e16d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Request method failure captured: Jun 01 04:34:08.265526 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: request: GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544 HTTP/1.1 Jun 01 04:34:08.265526 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept: application/json Jun 01 04:34:08.265526 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept-Encoding: identity Jun 01 04:34:08.265526 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Connection: close Jun 01 04:34:08.265526 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Length: 0 Jun 01 04:34:08.265526 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Type: application/json Jun 01 04:34:08.265526 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Host: 10.222.0.18 Jun 01 04:34:08.265526 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Openstack-System-Scope: None Jun 01 04:34:08.265526 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: User-Agent: python-urllib3/1.26.9 Jun 01 04:34:08.265526 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Auth-Token: gAAAAABiluuhrs68vRS8bmHX79HSLEC7Oto5BPtL8dAqHvw4xcvjDwmHZOq4iDquAqCiMvb88J6MD56RYbs0QMO2u_wuPhclaOhGjnf2V4BFXnnyauRkH0EWaJk48PQGCqHRBrxvcy_7Fcw0OlUZ5qUTBgWhVmwbyO4Ssx0EAbp5AaHN0b0jRNM Jun 01 04:34:08.265526 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Id: None Jun 01 04:34:08.265526 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Name: None Jun 01 04:34:08.265526 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Identity-Status: Confirmed Jun 01 04:34:08.265526 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Is-Admin-Project: True Jun 01 04:34:08.265526 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Id: default Jun 01 04:34:08.265526 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Name: Default Jun 01 04:34:08.265526 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Id: 7454aaeeba6b4a8c86a0446ae68dd4f1 Jun 01 04:34:08.265526 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1313661018 Jun 01 04:34:08.265526 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Role: reader,member Jun 01 04:34:08.265526 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Roles: reader,member Jun 01 04:34:08.267609 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7454aaeeba6b4a8c86a0446ae68dd4f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7454aaeeba6b4a8c86a0446ae68dd4f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7454aaeeba6b4a8c86a0446ae68dd4f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7454aaeeba6b4a8c86a0446ae68dd4f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:34:08.267609 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant: tempest-VolumesSnapshotTestJSON-1313661018 Jun 01 04:34:08.267609 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Id: 7454aaeeba6b4a8c86a0446ae68dd4f1 Jun 01 04:34:08.267609 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1313661018 Jun 01 04:34:08.267609 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User: tempest-VolumesSnapshotTestJSON-1313661018-project Jun 01 04:34:08.267609 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Id: default Jun 01 04:34:08.267609 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Name: Default Jun 01 04:34:08.267609 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Id: e249c6bada9d4dcb91b83a0a29ad552d Jun 01 04:34:08.267609 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Name: tempest-VolumesSnapshotTestJSON-1313661018-project Jun 01 04:34:08.267609 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: method: > Jun 01 04:34:08.267609 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: exception: Instance 8cacd474-e05d-4ec8-a35f-c111ca326544 could not be found. Jun 01 04:34:08.267609 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: action_args: {'id': '8cacd474-e05d-4ec8-a35f-c111ca326544'} Jun 01 04:34:08.268498 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:34:08.268498 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:34:08.268498 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:34:08.268498 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:34:08.268498 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:34:08.268498 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:34:08.268498 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:34:08.268498 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:34:08.268498 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:34:08.268498 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:34:08.268498 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cacd474-e05d-4ec8-a35f-c111ca326544 could not be found. Jun 01 04:34:08.268498 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:34:08.268498 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:34:08.268498 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:34:08.268498 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:34:08.268498 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:34:08.268498 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:34:08.268498 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:34:08.268498 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:34:08.268498 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:34:08.269759 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:34:08.269759 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 01 04:34:08.269759 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 01 04:34:08.269759 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:34:08.269759 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:34:08.269759 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:34:08.269759 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:34:08.269759 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cacd474-e05d-4ec8-a35f-c111ca326544 could not be found. Jun 01 04:34:08.269759 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:34:08.269759 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:34:08.269759 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:34:08.269759 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:34:08.269759 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:34:08.269759 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:34:08.269759 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:34:08.269759 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:34:08.269759 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cacd474-e05d-4ec8-a35f-c111ca326544 could not be found. Jun 01 04:34:08.269759 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:34:08.270865 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-b6f9702b-4334-497a-8173-b9c21f64e16d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] Returning 404 to user: Instance 8cacd474-e05d-4ec8-a35f-c111ca326544 could not be found. {{(pid=118517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:34:08.270865 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-b6f9702b-4334-497a-8173-b9c21f64e16d tempest-VolumesSnapshotTestJSON-1313661018 tempest-VolumesSnapshotTestJSON-1313661018-project] 10.222.0.18 "GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544" status: 404 len: 111 microversion: 2.1 time: 0.030210 Jun 01 04:34:08.270865 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 306/620] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:34:08 2022] GET /compute/v2.1/servers/8cacd474-e05d-4ec8-a35f-c111ca326544 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:34:15.291093 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-200eeffb-8e45-4b06-9a15-05d8d7d546a7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:15.291664 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-200eeffb-8e45-4b06-9a15-05d8d7d546a7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:15.298262 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-200eeffb-8e45-4b06-9a15-05d8d7d546a7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:15.298707 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-200eeffb-8e45-4b06-9a15-05d8d7d546a7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:15.299513 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-200eeffb-8e45-4b06-9a15-05d8d7d546a7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:15.300000 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-200eeffb-8e45-4b06-9a15-05d8d7d546a7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:15.328997 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-200eeffb-8e45-4b06-9a15-05d8d7d546a7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16/os-volume_attachments/98ac8378-a18b-4f21-b21a-78150d0ec68e" status: 200 len: 194 microversion: 2.20 time: 0.041950 Jun 01 04:34:15.329592 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 315/621] 10.222.0.18 () {60 vars in 1453 bytes} [Wed Jun 1 04:34:15 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16/os-volume_attachments/98ac8378-a18b-4f21-b21a-78150d0ec68e => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 01 04:34:15.391532 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-68795765-3252-4fb1-9e4b-7d61c244d843 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:15.392082 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-68795765-3252-4fb1-9e4b-7d61c244d843 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:15.398504 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-68795765-3252-4fb1-9e4b-7d61c244d843 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:15.398946 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-68795765-3252-4fb1-9e4b-7d61c244d843 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:15.399746 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-68795765-3252-4fb1-9e4b-7d61c244d843 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:15.400183 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-68795765-3252-4fb1-9e4b-7d61c244d843 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:15.481589 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.objects.instance [None req-68795765-3252-4fb1-9e4b-7d61c244d843 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lazy-loading 'services' on Instance uuid c961e06b-1b03-4e97-8487-57adba5d5e16 {{(pid=118517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:34:15.720675 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-68795765-3252-4fb1-9e4b-7d61c244d843 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16/os-volume_attachments/98ac8378-a18b-4f21-b21a-78150d0ec68e" status: 202 len: 0 microversion: 2.20 time: 0.333370 Jun 01 04:34:15.721359 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 307/622] 10.222.0.18 () {60 vars in 1456 bytes} [Wed Jun 1 04:34:15 2022] DELETE /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16/os-volume_attachments/98ac8378-a18b-4f21-b21a-78150d0ec68e => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 01 04:34:15.730950 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-1739eede-7ff7-4355-9814-1447d71efa2b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:15.731986 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-1739eede-7ff7-4355-9814-1447d71efa2b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:15.738375 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1739eede-7ff7-4355-9814-1447d71efa2b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:15.738832 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1739eede-7ff7-4355-9814-1447d71efa2b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:15.739717 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1739eede-7ff7-4355-9814-1447d71efa2b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:15.740160 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1739eede-7ff7-4355-9814-1447d71efa2b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:15.770122 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-1739eede-7ff7-4355-9814-1447d71efa2b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044032 Jun 01 04:34:15.770679 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 316/623] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Jun 1 04:34:15 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 01 04:34:16.782958 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-7e998411-f264-4ee3-9559-adde515fbc32 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:16.784063 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-7e998411-f264-4ee3-9559-adde515fbc32 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:16.790529 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7e998411-f264-4ee3-9559-adde515fbc32 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:16.790974 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7e998411-f264-4ee3-9559-adde515fbc32 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:16.791773 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7e998411-f264-4ee3-9559-adde515fbc32 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:16.792204 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7e998411-f264-4ee3-9559-adde515fbc32 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:16.822574 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-7e998411-f264-4ee3-9559-adde515fbc32 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044148 Jun 01 04:34:16.826569 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 308/624] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Jun 1 04:34:16 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 01 04:34:17.834461 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-9bafbdf8-7712-4a65-861e-4f1e4ee470a8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:17.835406 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-9bafbdf8-7712-4a65-861e-4f1e4ee470a8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:17.841876 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9bafbdf8-7712-4a65-861e-4f1e4ee470a8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:17.842462 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9bafbdf8-7712-4a65-861e-4f1e4ee470a8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:17.843144 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9bafbdf8-7712-4a65-861e-4f1e4ee470a8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:17.843657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9bafbdf8-7712-4a65-861e-4f1e4ee470a8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:17.879559 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-9bafbdf8-7712-4a65-861e-4f1e4ee470a8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048931 Jun 01 04:34:17.880032 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 317/625] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Jun 1 04:34:17 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:34:17.938619 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-686f8f19-b444-423f-add5-bd9098f61553 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:17.939161 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-686f8f19-b444-423f-add5-bd9098f61553 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:17.945629 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-686f8f19-b444-423f-add5-bd9098f61553 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:17.946081 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-686f8f19-b444-423f-add5-bd9098f61553 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:17.946859 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-686f8f19-b444-423f-add5-bd9098f61553 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:17.947296 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-686f8f19-b444-423f-add5-bd9098f61553 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:17.973381 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-686f8f19-b444-423f-add5-bd9098f61553 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Going to try to terminate instance {{(pid=118517) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 01 04:34:18.241724 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-686f8f19-b444-423f-add5-bd9098f61553 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 204 len: 0 microversion: 2.20 time: 0.306658 Jun 01 04:34:18.242297 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 309/626] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Jun 1 04:34:17 2022] DELETE /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 01 04:34:18.251689 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-327190a7-f17c-42c5-b6e9-de7d8ea4775b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:18.252383 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-327190a7-f17c-42c5-b6e9-de7d8ea4775b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:18.259213 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-327190a7-f17c-42c5-b6e9-de7d8ea4775b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:18.259898 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-327190a7-f17c-42c5-b6e9-de7d8ea4775b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:18.260940 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-327190a7-f17c-42c5-b6e9-de7d8ea4775b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:18.261381 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-327190a7-f17c-42c5-b6e9-de7d8ea4775b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:18.396108 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-327190a7-f17c-42c5-b6e9-de7d8ea4775b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:18.405010 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-327190a7-f17c-42c5-b6e9-de7d8ea4775b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:18.406522 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-327190a7-f17c-42c5-b6e9-de7d8ea4775b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:18.407799 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-327190a7-f17c-42c5-b6e9-de7d8ea4775b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1725 microversion: 2.20 time: 0.160782 Jun 01 04:34:18.408554 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 318/627] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:34:18 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:34:19.426838 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-7d9041f8-f8cf-413e-8744-b18f27d971c8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:19.427492 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-7d9041f8-f8cf-413e-8744-b18f27d971c8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:19.434116 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7d9041f8-f8cf-413e-8744-b18f27d971c8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:19.434588 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7d9041f8-f8cf-413e-8744-b18f27d971c8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:19.435337 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7d9041f8-f8cf-413e-8744-b18f27d971c8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:19.435813 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7d9041f8-f8cf-413e-8744-b18f27d971c8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:19.586585 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-7d9041f8-f8cf-413e-8744-b18f27d971c8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:19.596716 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-7d9041f8-f8cf-413e-8744-b18f27d971c8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:19.597910 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-7d9041f8-f8cf-413e-8744-b18f27d971c8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:19.599191 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-7d9041f8-f8cf-413e-8744-b18f27d971c8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1725 microversion: 2.20 time: 0.176656 Jun 01 04:34:19.600076 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 310/628] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:34:19 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:34:20.618364 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-13b290f8-d78f-4551-940e-86ba6bfa6fe0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:20.618916 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-13b290f8-d78f-4551-940e-86ba6bfa6fe0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:20.626233 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-13b290f8-d78f-4551-940e-86ba6bfa6fe0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:20.626684 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-13b290f8-d78f-4551-940e-86ba6bfa6fe0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:20.627534 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-13b290f8-d78f-4551-940e-86ba6bfa6fe0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:20.628907 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-13b290f8-d78f-4551-940e-86ba6bfa6fe0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:20.856775 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-13b290f8-d78f-4551-940e-86ba6bfa6fe0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:20.865434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-13b290f8-d78f-4551-940e-86ba6bfa6fe0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:20.866960 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-13b290f8-d78f-4551-940e-86ba6bfa6fe0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:20.868229 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-13b290f8-d78f-4551-940e-86ba6bfa6fe0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1725 microversion: 2.20 time: 0.254087 Jun 01 04:34:20.868846 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 319/629] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:34:20 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1725 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:34:21.331502 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-c620a571-2ab2-4b7e-8ce6-97c986a035c6 req-3f9889d7-3d55-4011-b4ac-23d00e2ca673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c961e06b-1b03-4e97-8487-57adba5d5e16", "name": "network-vif-deleted", "tag": "690b8ab1-955e-471f-b256-fa4681ea0480"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:34:21.340335 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-c620a571-2ab2-4b7e-8ce6-97c986a035c6 req-3f9889d7-3d55-4011-b4ac-23d00e2ca673 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:21.340793 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-c620a571-2ab2-4b7e-8ce6-97c986a035c6 req-3f9889d7-3d55-4011-b4ac-23d00e2ca673 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:21.352990 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-c620a571-2ab2-4b7e-8ce6-97c986a035c6 req-3f9889d7-3d55-4011-b4ac-23d00e2ca673 service nova] Creating event network-vif-deleted:690b8ab1-955e-471f-b256-fa4681ea0480 for instance c961e06b-1b03-4e97-8487-57adba5d5e16 on hv-cinder-66710 Jun 01 04:34:21.358091 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-c620a571-2ab2-4b7e-8ce6-97c986a035c6 req-3f9889d7-3d55-4011-b4ac-23d00e2ca673 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030520 Jun 01 04:34:21.362852 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 311/630] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:34:21.886179 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-3823c438-5fef-411c-bc13-a2ef38cc05e1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:21.886806 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-3823c438-5fef-411c-bc13-a2ef38cc05e1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:21.894012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3823c438-5fef-411c-bc13-a2ef38cc05e1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:21.894473 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3823c438-5fef-411c-bc13-a2ef38cc05e1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:21.895242 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3823c438-5fef-411c-bc13-a2ef38cc05e1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:21.895874 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3823c438-5fef-411c-bc13-a2ef38cc05e1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:21.935147 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3823c438-5fef-411c-bc13-a2ef38cc05e1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:21.935921 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3823c438-5fef-411c-bc13-a2ef38cc05e1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:21.936704 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.objects.instance [None req-3823c438-5fef-411c-bc13-a2ef38cc05e1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lazy-loading 'fault' on Instance uuid c961e06b-1b03-4e97-8487-57adba5d5e16 {{(pid=118516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:34:21.987909 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-3823c438-5fef-411c-bc13-a2ef38cc05e1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:21.998126 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-3823c438-5fef-411c-bc13-a2ef38cc05e1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:22.001571 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-3823c438-5fef-411c-bc13-a2ef38cc05e1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:22.001571 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-3823c438-5fef-411c-bc13-a2ef38cc05e1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 200 len: 1372 microversion: 2.20 time: 0.118883 Jun 01 04:34:22.001929 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 320/631] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:34:21 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 1372 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:34:23.020122 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-4138f5dc-fad5-46cb-ad33-dcc09f26ea6e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:23.020815 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-4138f5dc-fad5-46cb-ad33-dcc09f26ea6e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:23.027678 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4138f5dc-fad5-46cb-ad33-dcc09f26ea6e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:23.028132 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4138f5dc-fad5-46cb-ad33-dcc09f26ea6e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:23.028900 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4138f5dc-fad5-46cb-ad33-dcc09f26ea6e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:23.029339 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4138f5dc-fad5-46cb-ad33-dcc09f26ea6e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:23.045630 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.wsgi [None req-4138f5dc-fad5-46cb-ad33-dcc09f26ea6e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] HTTP exception thrown: Instance c961e06b-1b03-4e97-8487-57adba5d5e16 could not be found. Jun 01 04:34:23.049985 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-4138f5dc-fad5-46cb-ad33-dcc09f26ea6e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Request method failure captured: Jun 01 04:34:23.049985 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: request: GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 HTTP/1.1 Jun 01 04:34:23.049985 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept: application/json Jun 01 04:34:23.049985 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept-Encoding: identity Jun 01 04:34:23.049985 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Connection: close Jun 01 04:34:23.049985 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Length: 0 Jun 01 04:34:23.049985 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Type: application/json Jun 01 04:34:23.049985 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Host: 10.222.0.18 Jun 01 04:34:23.049985 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Openstack-System-Scope: None Jun 01 04:34:23.049985 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: User-Agent: python-urllib3/1.26.9 Jun 01 04:34:23.049985 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Auth-Token: gAAAAABiluq5u7ypIc9ZITgsT-vtjIRhVrjbwIre77jcNdNH4pkI-gIRC-CEEogVH__Z1e-ykDxcRA7tO7281ReQsPia7LV9oIIFHcV5Qu2Cxp7-UCfgJagoD93i5Vm2b1dRvJIVRWHyQ3Qup-O_ZazwFabUI1ovDM5gGbUEJI_aNZBiMmWdTYo Jun 01 04:34:23.049985 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Id: None Jun 01 04:34:23.049985 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Name: None Jun 01 04:34:23.049985 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Identity-Status: Confirmed Jun 01 04:34:23.049985 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Is-Admin-Project: True Jun 01 04:34:23.049985 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Openstack-Nova-Api-Version: 2.20 Jun 01 04:34:23.049985 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Id: default Jun 01 04:34:23.049985 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Name: Default Jun 01 04:34:23.049985 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Id: d12a9b5dc38b4aa7aed77adc89d0e6a4 Jun 01 04:34:23.049985 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-228179451 Jun 01 04:34:23.049985 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Role: reader,member Jun 01 04:34:23.049985 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Roles: reader,member Jun 01 04:34:23.051457 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d12a9b5dc38b4aa7aed77adc89d0e6a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d12a9b5dc38b4aa7aed77adc89d0e6a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d12a9b5dc38b4aa7aed77adc89d0e6a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d12a9b5dc38b4aa7aed77adc89d0e6a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:34:23.051457 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant: tempest-AttachVolumeShelveTestJSON-228179451 Jun 01 04:34:23.051457 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Id: d12a9b5dc38b4aa7aed77adc89d0e6a4 Jun 01 04:34:23.051457 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-228179451 Jun 01 04:34:23.051457 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User: tempest-AttachVolumeShelveTestJSON-228179451-project Jun 01 04:34:23.051457 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Id: default Jun 01 04:34:23.051457 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Name: Default Jun 01 04:34:23.051457 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Id: 85df2f6595d3489bb5d1d547cb2cd900 Jun 01 04:34:23.051457 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Name: tempest-AttachVolumeShelveTestJSON-228179451-project Jun 01 04:34:23.051457 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: method: > Jun 01 04:34:23.051457 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: exception: Instance c961e06b-1b03-4e97-8487-57adba5d5e16 could not be found. Jun 01 04:34:23.051457 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: action_args: {'id': 'c961e06b-1b03-4e97-8487-57adba5d5e16'} Jun 01 04:34:23.052212 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:34:23.052212 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:34:23.052212 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:34:23.052212 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:34:23.052212 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:34:23.052212 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:34:23.052212 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:34:23.052212 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:34:23.052212 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:34:23.052212 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:34:23.052212 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c961e06b-1b03-4e97-8487-57adba5d5e16 could not be found. Jun 01 04:34:23.052212 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:34:23.052212 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:34:23.052212 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:34:23.052212 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:34:23.052212 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:34:23.052212 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:34:23.052212 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:34:23.052212 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:34:23.052212 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:34:23.053361 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:34:23.053361 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 01 04:34:23.053361 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 01 04:34:23.053361 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:34:23.053361 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:34:23.053361 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:34:23.053361 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:34:23.053361 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c961e06b-1b03-4e97-8487-57adba5d5e16 could not be found. Jun 01 04:34:23.053361 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:34:23.053361 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:34:23.053361 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:34:23.053361 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:34:23.053361 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:34:23.053361 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:34:23.053361 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:34:23.053361 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:34:23.053361 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c961e06b-1b03-4e97-8487-57adba5d5e16 could not be found. Jun 01 04:34:23.053361 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:34:23.054435 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-4138f5dc-fad5-46cb-ad33-dcc09f26ea6e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Returning 404 to user: Instance c961e06b-1b03-4e97-8487-57adba5d5e16 could not be found. {{(pid=118517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:34:23.054435 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-4138f5dc-fad5-46cb-ad33-dcc09f26ea6e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 404 len: 111 microversion: 2.20 time: 0.033523 Jun 01 04:34:23.054435 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 312/632] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:34:23 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 01 04:34:23.059940 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-2720fa83-98c4-477a-a785-05ee3eb2120f tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '.version_select at 0x7ff3259a8670>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:23.122313 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-2720fa83-98c4-477a-a785-05ee3eb2120f tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1989291720" status: 204 len: 0 microversion: 2.20 time: 0.066163 Jun 01 04:34:23.122995 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 321/633] 10.222.0.18 () {60 vars in 1261 bytes} [Wed Jun 1 04:34:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1989291720 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 01 04:34:23.923960 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-e9e6fc27-eb80-464b-8c77-ea5565c4c8ce tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Action: 'create', calling method: .version_select at 0x7ff3259498b0>, body: {"keypair": {"name": "tempest-keypair-1546097504", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFt4WrW9q9kQIsqj4ouOx2Ll+w0EYgmHD6ctD8LdFQwKuL2IHOFxq8yS8M5lcxQc9RXBG/jIi7uqLyO7Ujc3jnLz6v3z8/fXlgdE8yv+wtTMukgxKPQYtz9BlqFNRbv1w=="}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:34:23.938243 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.quota [None req-e9e6fc27-eb80-464b-8c77-ea5565c4c8ce tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Getting quotas for project d12a9b5dc38b4aa7aed77adc89d0e6a4. Resources: {'key_pairs'} {{(pid=118517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:34:23.942013 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.quota [None req-e9e6fc27-eb80-464b-8c77-ea5565c4c8ce tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Getting quotas for user 85df2f6595d3489bb5d1d547cb2cd900 and project d12a9b5dc38b4aa7aed77adc89d0e6a4. Resources: {'key_pairs'} {{(pid=118517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:34:24.046464 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-e9e6fc27-eb80-464b-8c77-ea5565c4c8ce tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.126430 Jun 01 04:34:24.047127 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 313/634] 10.222.0.18 () {62 vars in 1199 bytes} [Wed Jun 1 04:34:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 01 04:34:26.240175 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-25c0ab84-b7f0-4131-a040-7283a598c65c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1572223088", "imageRef": "14321baa-3ac5-4c53-8054-4945abce5b2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0672bd5d-634b-4f48-aa77-f628be2afa15"}], "security_groups": [{"name": "tempest-securitygroup--1539828214"}], "key_name": "tempest-keypair-1546097504", "user_data": "}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:34:26.346472 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.network.neutron [None req-25c0ab84-b7f0-4131-a040-7283a598c65c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] validate_networks() for [('0672bd5d-634b-4f48-aa77-f628be2afa15', None, None, None, None, None)] {{(pid=118516) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 01 04:34:26.710588 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-25c0ab84-b7f0-4131-a040-7283a598c65c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Flavor limits 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 01 04:34:26.711006 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-25c0ab84-b7f0-4131-a040-7283a598c65c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Image limits 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 01 04:34:26.711517 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-25c0ab84-b7f0-4131-a040-7283a598c65c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Flavor pref 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 01 04:34:26.711929 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-25c0ab84-b7f0-4131-a040-7283a598c65c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Image pref 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 01 04:34:26.712372 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-25c0ab84-b7f0-4131-a040-7283a598c65c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 01 04:34:26.721535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-25c0ab84-b7f0-4131-a040-7283a598c65c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:26.721978 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-25c0ab84-b7f0-4131-a040-7283a598c65c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:26.722770 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-25c0ab84-b7f0-4131-a040-7283a598c65c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:26.723201 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-25c0ab84-b7f0-4131-a040-7283a598c65c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:26.740545 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-25c0ab84-b7f0-4131-a040-7283a598c65c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Getting quotas for project d12a9b5dc38b4aa7aed77adc89d0e6a4. Resources: {'ram', 'instances', 'cores'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:34:26.744726 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-25c0ab84-b7f0-4131-a040-7283a598c65c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Getting quotas for user 85df2f6595d3489bb5d1d547cb2cd900 and project d12a9b5dc38b4aa7aed77adc89d0e6a4. Resources: {'ram', 'instances', 'cores'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:34:26.756294 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-25c0ab84-b7f0-4131-a040-7283a598c65c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Going to run 1 instances... {{(pid=118516) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 01 04:34:26.758554 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-25c0ab84-b7f0-4131-a040-7283a598c65c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14321baa-3ac5-4c53-8054-4945abce5b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 01 04:34:26.933353 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-25c0ab84-b7f0-4131-a040-7283a598c65c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.698415 Jun 01 04:34:26.933946 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 322/635] 10.222.0.18 () {62 vars in 1187 bytes} [Wed Jun 1 04:34:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 01 04:34:26.944562 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-221ca488-1929-4b67-a7b9-ec5075b1bccc tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:26.945170 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-221ca488-1929-4b67-a7b9-ec5075b1bccc tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:27.003023 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-221ca488-1929-4b67-a7b9-ec5075b1bccc tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:27.011023 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-221ca488-1929-4b67-a7b9-ec5075b1bccc tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:27.012648 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-221ca488-1929-4b67-a7b9-ec5075b1bccc tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:27.013671 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-221ca488-1929-4b67-a7b9-ec5075b1bccc tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1282 microversion: 2.20 time: 0.073028 Jun 01 04:34:27.014360 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 314/636] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:34:26 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1282 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:34:28.032154 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-bb68ec2e-1f10-43d8-8939-da74f8c17095 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:28.036013 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-bb68ec2e-1f10-43d8-8939-da74f8c17095 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:28.042887 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bb68ec2e-1f10-43d8-8939-da74f8c17095 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:28.043641 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bb68ec2e-1f10-43d8-8939-da74f8c17095 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:28.044873 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bb68ec2e-1f10-43d8-8939-da74f8c17095 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:28.045586 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bb68ec2e-1f10-43d8-8939-da74f8c17095 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:28.123596 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-bb68ec2e-1f10-43d8-8939-da74f8c17095 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:28.131991 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-bb68ec2e-1f10-43d8-8939-da74f8c17095 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:28.133553 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-bb68ec2e-1f10-43d8-8939-da74f8c17095 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:28.134657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-bb68ec2e-1f10-43d8-8939-da74f8c17095 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1286 microversion: 2.20 time: 0.107243 Jun 01 04:34:28.135565 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 323/637] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:34:28 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:34:29.158901 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-02001103-cafc-49fc-9047-e7ee6715dbe8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:29.159543 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-02001103-cafc-49fc-9047-e7ee6715dbe8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:29.166372 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-02001103-cafc-49fc-9047-e7ee6715dbe8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:29.166843 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-02001103-cafc-49fc-9047-e7ee6715dbe8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:29.167716 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-02001103-cafc-49fc-9047-e7ee6715dbe8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:29.168154 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-02001103-cafc-49fc-9047-e7ee6715dbe8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:29.229722 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-02001103-cafc-49fc-9047-e7ee6715dbe8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:29.238729 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-02001103-cafc-49fc-9047-e7ee6715dbe8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:29.240277 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-02001103-cafc-49fc-9047-e7ee6715dbe8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:29.241499 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-02001103-cafc-49fc-9047-e7ee6715dbe8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1352 microversion: 2.20 time: 0.087384 Jun 01 04:34:29.241914 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 315/638] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:34:29 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:34:30.261966 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-04e66afb-af73-40a1-b4b2-497e75c65428 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:30.262586 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-04e66afb-af73-40a1-b4b2-497e75c65428 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:30.270033 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-04e66afb-af73-40a1-b4b2-497e75c65428 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:30.270416 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-04e66afb-af73-40a1-b4b2-497e75c65428 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:30.271193 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-04e66afb-af73-40a1-b4b2-497e75c65428 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:30.271661 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-04e66afb-af73-40a1-b4b2-497e75c65428 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:30.539387 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-04e66afb-af73-40a1-b4b2-497e75c65428 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:30.547354 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-04e66afb-af73-40a1-b4b2-497e75c65428 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:30.549369 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-04e66afb-af73-40a1-b4b2-497e75c65428 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:30.550012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-04e66afb-af73-40a1-b4b2-497e75c65428 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1408 microversion: 2.20 time: 0.293931 Jun 01 04:34:30.550563 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 324/639] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:34:30 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1408 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:34:31.070645 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-763b6cfe-1296-4f73-b01e-5d84f745dd55 req-90d47d2a-38c1-4d4f-b75d-bcf01d19048e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3958973-f8ca-4c63-b27b-72c3e272604e", "tag": "0b29defe-ef89-4b36-89eb-0cd5d2fb4aea"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:34:31.081440 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-763b6cfe-1296-4f73-b01e-5d84f745dd55 req-90d47d2a-38c1-4d4f-b75d-bcf01d19048e service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:31.082411 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-763b6cfe-1296-4f73-b01e-5d84f745dd55 req-90d47d2a-38c1-4d4f-b75d-bcf01d19048e service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:31.105685 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-763b6cfe-1296-4f73-b01e-5d84f745dd55 req-90d47d2a-38c1-4d4f-b75d-bcf01d19048e service nova] Creating event network-changed:0b29defe-ef89-4b36-89eb-0cd5d2fb4aea for instance a3958973-f8ca-4c63-b27b-72c3e272604e on hv-cinder-66710 Jun 01 04:34:31.111848 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-763b6cfe-1296-4f73-b01e-5d84f745dd55 req-90d47d2a-38c1-4d4f-b75d-bcf01d19048e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045236 Jun 01 04:34:31.112635 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 316/640] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:34:31.568409 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-04af994a-2ce4-49ea-b5cf-92d89329c731 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:31.568969 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-04af994a-2ce4-49ea-b5cf-92d89329c731 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:31.571650 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:31.576279 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-04af994a-2ce4-49ea-b5cf-92d89329c731 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:31.576721 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-04af994a-2ce4-49ea-b5cf-92d89329c731 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:31.577485 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-04af994a-2ce4-49ea-b5cf-92d89329c731 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:31.577915 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-04af994a-2ce4-49ea-b5cf-92d89329c731 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:31.583650 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=1 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:31.787743 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-04af994a-2ce4-49ea-b5cf-92d89329c731 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:31.795573 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-04af994a-2ce4-49ea-b5cf-92d89329c731 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:31.798046 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-04af994a-2ce4-49ea-b5cf-92d89329c731 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:31.798875 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-04af994a-2ce4-49ea-b5cf-92d89329c731 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1408 microversion: 2.20 time: 0.234403 Jun 01 04:34:31.799451 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 325/641] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:34:31 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1408 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:34:32.817324 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-8c4d93c4-9e73-4484-ab75-5ef8174f6785 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:32.818011 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-8c4d93c4-9e73-4484-ab75-5ef8174f6785 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:32.824726 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8c4d93c4-9e73-4484-ab75-5ef8174f6785 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:32.825238 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8c4d93c4-9e73-4484-ab75-5ef8174f6785 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:32.830329 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8c4d93c4-9e73-4484-ab75-5ef8174f6785 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:32.830329 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8c4d93c4-9e73-4484-ab75-5ef8174f6785 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:32.962045 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-8c4d93c4-9e73-4484-ab75-5ef8174f6785 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:32.970523 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-8c4d93c4-9e73-4484-ab75-5ef8174f6785 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:32.972043 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-8c4d93c4-9e73-4484-ab75-5ef8174f6785 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:32.973127 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-8c4d93c4-9e73-4484-ab75-5ef8174f6785 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1408 microversion: 2.20 time: 0.160717 Jun 01 04:34:32.973674 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 317/642] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:34:32 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:34:33.991818 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-439765aa-296c-4b70-925b-a36ce0d902e0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:33.992828 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-439765aa-296c-4b70-925b-a36ce0d902e0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:34.004285 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-439765aa-296c-4b70-925b-a36ce0d902e0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:34.004802 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-439765aa-296c-4b70-925b-a36ce0d902e0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:34.005871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-439765aa-296c-4b70-925b-a36ce0d902e0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:34.006323 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-439765aa-296c-4b70-925b-a36ce0d902e0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:34.148939 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-439765aa-296c-4b70-925b-a36ce0d902e0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:34.157708 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-439765aa-296c-4b70-925b-a36ce0d902e0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:34.159329 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-439765aa-296c-4b70-925b-a36ce0d902e0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:34.160455 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-439765aa-296c-4b70-925b-a36ce0d902e0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1408 microversion: 2.20 time: 0.173213 Jun 01 04:34:34.161017 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 326/643] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:34:33 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:34:35.178908 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-05a80d31-088c-4ab7-acef-d74be93067a8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:35.179571 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-05a80d31-088c-4ab7-acef-d74be93067a8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:35.182126 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:35.187042 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-05a80d31-088c-4ab7-acef-d74be93067a8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:35.187533 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-05a80d31-088c-4ab7-acef-d74be93067a8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:35.188322 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-05a80d31-088c-4ab7-acef-d74be93067a8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:35.188322 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-05a80d31-088c-4ab7-acef-d74be93067a8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:35.191498 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:35.324961 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-05a80d31-088c-4ab7-acef-d74be93067a8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:35.334093 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-05a80d31-088c-4ab7-acef-d74be93067a8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:35.335610 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-05a80d31-088c-4ab7-acef-d74be93067a8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:35.336714 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-05a80d31-088c-4ab7-acef-d74be93067a8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1408 microversion: 2.20 time: 0.161816 Jun 01 04:34:35.337271 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 318/644] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:34:35 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:34:36.354996 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-0e7d76bf-ff4c-40ec-b952-e3859a08611b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:36.355684 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-0e7d76bf-ff4c-40ec-b952-e3859a08611b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:36.363270 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0e7d76bf-ff4c-40ec-b952-e3859a08611b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:36.363743 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0e7d76bf-ff4c-40ec-b952-e3859a08611b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:36.364498 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0e7d76bf-ff4c-40ec-b952-e3859a08611b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:36.364933 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0e7d76bf-ff4c-40ec-b952-e3859a08611b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:36.494737 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-0e7d76bf-ff4c-40ec-b952-e3859a08611b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:36.503277 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-0e7d76bf-ff4c-40ec-b952-e3859a08611b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:36.504838 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-0e7d76bf-ff4c-40ec-b952-e3859a08611b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:36.505930 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-0e7d76bf-ff4c-40ec-b952-e3859a08611b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1408 microversion: 2.20 time: 0.155116 Jun 01 04:34:36.506481 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 327/645] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:34:36 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:34:37.095432 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-ec07fab8-e2c2-423e-9243-df90aaff4901 req-436e0d22-1e20-4e82-9f8b-9f76db19b4b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3958973-f8ca-4c63-b27b-72c3e272604e", "name": "network-vif-plugged", "status": "completed", "tag": "0b29defe-ef89-4b36-89eb-0cd5d2fb4aea"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:34:37.099099 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell0:SELECT=6 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:37.105580 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-ec07fab8-e2c2-423e-9243-df90aaff4901 req-436e0d22-1e20-4e82-9f8b-9f76db19b4b9 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:37.106021 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-ec07fab8-e2c2-423e-9243-df90aaff4901 req-436e0d22-1e20-4e82-9f8b-9f76db19b4b9 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:37.117027 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-ec07fab8-e2c2-423e-9243-df90aaff4901 req-436e0d22-1e20-4e82-9f8b-9f76db19b4b9 service nova] Creating event network-vif-plugged:0b29defe-ef89-4b36-89eb-0cd5d2fb4aea for instance a3958973-f8ca-4c63-b27b-72c3e272604e on hv-cinder-66710 Jun 01 04:34:37.122016 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-ec07fab8-e2c2-423e-9243-df90aaff4901 req-436e0d22-1e20-4e82-9f8b-9f76db19b4b9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031239 Jun 01 04:34:37.128339 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 319/646] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:34:37.524346 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-97092815-a7b7-4983-8821-19a93030f234 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:37.525156 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-97092815-a7b7-4983-8821-19a93030f234 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:37.528355 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell0:SELECT=2 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:37.529109 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell0:SELECT=6 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:37.533346 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-97092815-a7b7-4983-8821-19a93030f234 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:37.533913 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-97092815-a7b7-4983-8821-19a93030f234 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:37.534807 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-97092815-a7b7-4983-8821-19a93030f234 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:37.535524 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-97092815-a7b7-4983-8821-19a93030f234 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:37.854512 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-97092815-a7b7-4983-8821-19a93030f234 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:37.863117 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-97092815-a7b7-4983-8821-19a93030f234 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:37.864648 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-97092815-a7b7-4983-8821-19a93030f234 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:37.865740 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-97092815-a7b7-4983-8821-19a93030f234 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1408 microversion: 2.20 time: 0.345840 Jun 01 04:34:37.866289 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 328/647] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:34:37 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1408 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:34:38.885415 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-67865027-d011-4b9c-9047-7277990eb108 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:38.886203 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-67865027-d011-4b9c-9047-7277990eb108 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:38.894705 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-67865027-d011-4b9c-9047-7277990eb108 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:38.895161 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-67865027-d011-4b9c-9047-7277990eb108 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:38.895965 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-67865027-d011-4b9c-9047-7277990eb108 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:38.896426 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-67865027-d011-4b9c-9047-7277990eb108 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:39.168697 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-67865027-d011-4b9c-9047-7277990eb108 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:39.177636 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-67865027-d011-4b9c-9047-7277990eb108 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:39.179126 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-67865027-d011-4b9c-9047-7277990eb108 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:39.180363 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-67865027-d011-4b9c-9047-7277990eb108 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1408 microversion: 2.20 time: 0.300314 Jun 01 04:34:39.180913 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 320/648] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:34:38 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1408 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:34:40.197912 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-baaad42c-fe0c-4fe3-abaa-fe8336d8d543 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:40.198517 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-baaad42c-fe0c-4fe3-abaa-fe8336d8d543 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:40.205940 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-baaad42c-fe0c-4fe3-abaa-fe8336d8d543 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:40.206400 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-baaad42c-fe0c-4fe3-abaa-fe8336d8d543 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:40.207173 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-baaad42c-fe0c-4fe3-abaa-fe8336d8d543 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:40.207648 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-baaad42c-fe0c-4fe3-abaa-fe8336d8d543 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:40.342171 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-baaad42c-fe0c-4fe3-abaa-fe8336d8d543 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:40.349949 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-baaad42c-fe0c-4fe3-abaa-fe8336d8d543 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:40.351480 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-baaad42c-fe0c-4fe3-abaa-fe8336d8d543 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:40.352634 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-baaad42c-fe0c-4fe3-abaa-fe8336d8d543 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1601 microversion: 2.20 time: 0.158632 Jun 01 04:34:40.353176 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 329/649] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:34:40 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:34:40.370384 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-99e16a59-df96-48c9-9e0a-46837739e4d8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:40.370886 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-99e16a59-df96-48c9-9e0a-46837739e4d8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:40.377878 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-99e16a59-df96-48c9-9e0a-46837739e4d8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:40.378325 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-99e16a59-df96-48c9-9e0a-46837739e4d8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:40.379079 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-99e16a59-df96-48c9-9e0a-46837739e4d8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:40.379545 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-99e16a59-df96-48c9-9e0a-46837739e4d8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:40.455968 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-99e16a59-df96-48c9-9e0a-46837739e4d8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.089195 Jun 01 04:34:40.456904 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 321/650] 10.222.0.18 () {60 vars in 1315 bytes} [Wed Jun 1 04:34:40 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 01 04:34:41.449382 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-51bcaab9-22f7-470c-9e49-3742f681ac14 req-f07108d5-061b-44fc-86e5-0b989303478e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3958973-f8ca-4c63-b27b-72c3e272604e", "tag": "0b29defe-ef89-4b36-89eb-0cd5d2fb4aea"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:34:41.458186 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-51bcaab9-22f7-470c-9e49-3742f681ac14 req-f07108d5-061b-44fc-86e5-0b989303478e service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:41.458686 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-51bcaab9-22f7-470c-9e49-3742f681ac14 req-f07108d5-061b-44fc-86e5-0b989303478e service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:41.470317 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-51bcaab9-22f7-470c-9e49-3742f681ac14 req-f07108d5-061b-44fc-86e5-0b989303478e service nova] Creating event network-changed:0b29defe-ef89-4b36-89eb-0cd5d2fb4aea for instance a3958973-f8ca-4c63-b27b-72c3e272604e on hv-cinder-66710 Jun 01 04:34:41.475480 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-51bcaab9-22f7-470c-9e49-3742f681ac14 req-f07108d5-061b-44fc-86e5-0b989303478e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029756 Jun 01 04:34:41.476269 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 330/651] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:34:48.333239 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-1f809da4-6469-4e0e-9860-a79a184d95b1 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:48.333758 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-1f809da4-6469-4e0e-9860-a79a184d95b1 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:48.339822 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1f809da4-6469-4e0e-9860-a79a184d95b1 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:48.340266 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1f809da4-6469-4e0e-9860-a79a184d95b1 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:48.341127 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1f809da4-6469-4e0e-9860-a79a184d95b1 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:48.341728 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1f809da4-6469-4e0e-9860-a79a184d95b1 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:48.426618 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.objects.instance [None req-1f809da4-6469-4e0e-9860-a79a184d95b1 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lazy-loading 'services' on Instance uuid f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 {{(pid=118517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:34:48.679206 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-1f809da4-6469-4e0e-9860-a79a184d95b1 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95/os-volume_attachments/2c562a5c-835a-41f9-bbbf-ecbeb8faad9d" status: 202 len: 0 microversion: 2.1 time: 0.612309 Jun 01 04:34:48.679965 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 322/652] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 1 04:34:48 2022] DELETE /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95/os-volume_attachments/2c562a5c-835a-41f9-bbbf-ecbeb8faad9d => generated 0 bytes in 614 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 01 04:34:48.986083 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-21c89ce2-efc9-4ac9-b96b-7ea580e92726 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:48.987591 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-21c89ce2-efc9-4ac9-b96b-7ea580e92726 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:49.001140 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-21c89ce2-efc9-4ac9-b96b-7ea580e92726 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:49.001802 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-21c89ce2-efc9-4ac9-b96b-7ea580e92726 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:49.004951 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-21c89ce2-efc9-4ac9-b96b-7ea580e92726 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:49.005613 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-21c89ce2-efc9-4ac9-b96b-7ea580e92726 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:49.117581 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.objects.instance [None req-21c89ce2-efc9-4ac9-b96b-7ea580e92726 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lazy-loading 'services' on Instance uuid 9f8eae96-794e-4cdb-a397-0f892e3fd9f0 {{(pid=118516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:34:49.356077 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-21c89ce2-efc9-4ac9-b96b-7ea580e92726 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0/os-volume_attachments/bf7c57d1-aa77-44dc-a43c-c9f656433a61" status: 202 len: 0 microversion: 2.1 time: 0.375987 Jun 01 04:34:49.356601 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 331/653] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 1 04:34:48 2022] DELETE /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0/os-volume_attachments/bf7c57d1-aa77-44dc-a43c-c9f656433a61 => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 01 04:34:49.374003 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-756ab2b3-0ebf-4635-9e86-a5cb25970baa tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:49.376776 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-756ab2b3-0ebf-4635-9e86-a5cb25970baa tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:49.393615 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-756ab2b3-0ebf-4635-9e86-a5cb25970baa tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:49.394254 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-756ab2b3-0ebf-4635-9e86-a5cb25970baa tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:49.395148 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-756ab2b3-0ebf-4635-9e86-a5cb25970baa tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:49.397984 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-756ab2b3-0ebf-4635-9e86-a5cb25970baa tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:49.475136 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-756ab2b3-0ebf-4635-9e86-a5cb25970baa tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113180 Jun 01 04:34:49.476769 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 323/654] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 1 04:34:49 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:34:50.489446 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-55122d69-a136-498b-a211-436987b4d389 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:50.490777 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-55122d69-a136-498b-a211-436987b4d389 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:50.498040 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-55122d69-a136-498b-a211-436987b4d389 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:50.498887 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-55122d69-a136-498b-a211-436987b4d389 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:50.500569 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-55122d69-a136-498b-a211-436987b4d389 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:50.501630 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-55122d69-a136-498b-a211-436987b4d389 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:50.537835 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-55122d69-a136-498b-a211-436987b4d389 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053864 Jun 01 04:34:50.538408 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 332/655] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 1 04:34:50 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:34:50.887583 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-dc6872e3-04fe-43c2-b560-ef3830c3c88d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:34:50.894686 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-dc6872e3-04fe-43c2-b560-ef3830c3c88d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:50.895138 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-dc6872e3-04fe-43c2-b560-ef3830c3c88d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:50.918773 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-dc6872e3-04fe-43c2-b560-ef3830c3c88d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Going to try to stop instance {{(pid=118517) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 01 04:34:51.128539 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-dc6872e3-04fe-43c2-b560-ef3830c3c88d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "POST /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95/action" status: 202 len: 0 microversion: 2.1 time: 0.244071 Jun 01 04:34:51.137663 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-8417abca-2636-49a2-a7dc-f8fa6484cc97 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:51.138775 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-8417abca-2636-49a2-a7dc-f8fa6484cc97 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:51.141461 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 324/656] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 1 04:34:50 2022] POST /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 01 04:34:51.146034 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8417abca-2636-49a2-a7dc-f8fa6484cc97 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:51.146494 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8417abca-2636-49a2-a7dc-f8fa6484cc97 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:51.147337 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8417abca-2636-49a2-a7dc-f8fa6484cc97 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:51.147784 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8417abca-2636-49a2-a7dc-f8fa6484cc97 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:51.320464 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-8417abca-2636-49a2-a7dc-f8fa6484cc97 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:51.329828 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-8417abca-2636-49a2-a7dc-f8fa6484cc97 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1675 microversion: 2.1 time: 0.196103 Jun 01 04:34:51.330732 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 333/657] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:34:51 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1675 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:34:51.551149 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-25b3832c-3d82-47b9-802a-ff4fba0452fb tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:51.553363 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-25b3832c-3d82-47b9-802a-ff4fba0452fb tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:51.563579 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-25b3832c-3d82-47b9-802a-ff4fba0452fb tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:51.564457 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-25b3832c-3d82-47b9-802a-ff4fba0452fb tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:51.565447 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-25b3832c-3d82-47b9-802a-ff4fba0452fb tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:51.566055 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-25b3832c-3d82-47b9-802a-ff4fba0452fb tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:51.616624 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-25b3832c-3d82-47b9-802a-ff4fba0452fb tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070553 Jun 01 04:34:51.617839 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 325/658] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 1 04:34:51 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 01 04:34:51.700141 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-087ecbb2-7b80-4704-85ff-4c8e2bffaebd tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:51.700698 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-087ecbb2-7b80-4704-85ff-4c8e2bffaebd tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:51.709121 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-087ecbb2-7b80-4704-85ff-4c8e2bffaebd tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:51.710549 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-087ecbb2-7b80-4704-85ff-4c8e2bffaebd tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:51.712095 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-087ecbb2-7b80-4704-85ff-4c8e2bffaebd tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:51.712805 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-087ecbb2-7b80-4704-85ff-4c8e2bffaebd tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:51.749166 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-087ecbb2-7b80-4704-85ff-4c8e2bffaebd tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Going to try to terminate instance {{(pid=118516) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 01 04:34:52.063916 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-087ecbb2-7b80-4704-85ff-4c8e2bffaebd tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 204 len: 0 microversion: 2.1 time: 0.368726 Jun 01 04:34:52.065157 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 334/659] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 1 04:34:51 2022] DELETE /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 01 04:34:52.073130 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-23a63e38-91ec-4b3f-afaa-7521c1291022 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:52.074461 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-23a63e38-91ec-4b3f-afaa-7521c1291022 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:52.082286 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-23a63e38-91ec-4b3f-afaa-7521c1291022 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:52.083162 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-23a63e38-91ec-4b3f-afaa-7521c1291022 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:52.087136 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-23a63e38-91ec-4b3f-afaa-7521c1291022 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:52.087136 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-23a63e38-91ec-4b3f-afaa-7521c1291022 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:52.284288 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-23a63e38-91ec-4b3f-afaa-7521c1291022 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:52.293279 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-23a63e38-91ec-4b3f-afaa-7521c1291022 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1688 microversion: 2.1 time: 0.224047 Jun 01 04:34:52.293855 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 326/660] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:34:52 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1688 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:34:52.348228 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-17874d60-c1c4-41ba-b581-976caefdf70a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:52.355348 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-17874d60-c1c4-41ba-b581-976caefdf70a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:52.355895 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-17874d60-c1c4-41ba-b581-976caefdf70a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:52.356542 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-17874d60-c1c4-41ba-b581-976caefdf70a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:52.357399 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-17874d60-c1c4-41ba-b581-976caefdf70a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:52.357913 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-17874d60-c1c4-41ba-b581-976caefdf70a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:52.511559 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-17874d60-c1c4-41ba-b581-976caefdf70a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:52.521232 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-17874d60-c1c4-41ba-b581-976caefdf70a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1675 microversion: 2.1 time: 0.177437 Jun 01 04:34:52.522091 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 335/661] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:34:52 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1675 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:34:53.314697 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-ca03627c-22a0-4a55-a245-345d44002f2e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:53.315294 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-ca03627c-22a0-4a55-a245-345d44002f2e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:53.332741 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ca03627c-22a0-4a55-a245-345d44002f2e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:53.335480 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ca03627c-22a0-4a55-a245-345d44002f2e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:53.342430 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ca03627c-22a0-4a55-a245-345d44002f2e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:53.343054 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ca03627c-22a0-4a55-a245-345d44002f2e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:53.538218 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-702afc78-15ca-4f48-a920-1c9ebb587e6f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:53.538927 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-702afc78-15ca-4f48-a920-1c9ebb587e6f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:53.545857 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-ca03627c-22a0-4a55-a245-345d44002f2e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:53.563034 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-ca03627c-22a0-4a55-a245-345d44002f2e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1688 microversion: 2.1 time: 0.248874 Jun 01 04:34:53.563034 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 327/662] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:34:53 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1688 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:34:53.563273 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-702afc78-15ca-4f48-a920-1c9ebb587e6f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:53.563273 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-702afc78-15ca-4f48-a920-1c9ebb587e6f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:53.563273 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-702afc78-15ca-4f48-a920-1c9ebb587e6f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:53.563273 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-702afc78-15ca-4f48-a920-1c9ebb587e6f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:53.747742 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-702afc78-15ca-4f48-a920-1c9ebb587e6f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:53.756726 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-702afc78-15ca-4f48-a920-1c9ebb587e6f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1675 microversion: 2.1 time: 0.222658 Jun 01 04:34:53.757627 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 336/663] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:34:53 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1675 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:34:54.579234 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-389db309-aa6e-4364-b770-1dcf217741e3 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:54.579913 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-389db309-aa6e-4364-b770-1dcf217741e3 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:54.587557 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-389db309-aa6e-4364-b770-1dcf217741e3 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:54.588293 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-389db309-aa6e-4364-b770-1dcf217741e3 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:54.589079 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-389db309-aa6e-4364-b770-1dcf217741e3 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:54.589524 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-389db309-aa6e-4364-b770-1dcf217741e3 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:54.759480 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-389db309-aa6e-4364-b770-1dcf217741e3 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:54.768565 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-389db309-aa6e-4364-b770-1dcf217741e3 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1688 microversion: 2.1 time: 0.194053 Jun 01 04:34:54.769142 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 328/664] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:34:54 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1688 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:34:54.779151 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-435797b1-c13f-4f80-a4a6-53c429c42fc5 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:54.779804 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-435797b1-c13f-4f80-a4a6-53c429c42fc5 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:54.787631 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-435797b1-c13f-4f80-a4a6-53c429c42fc5 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:54.788092 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-435797b1-c13f-4f80-a4a6-53c429c42fc5 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:54.789329 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-435797b1-c13f-4f80-a4a6-53c429c42fc5 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:54.790961 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-435797b1-c13f-4f80-a4a6-53c429c42fc5 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:54.951203 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-435797b1-c13f-4f80-a4a6-53c429c42fc5 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:54.959343 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-435797b1-c13f-4f80-a4a6-53c429c42fc5 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1675 microversion: 2.1 time: 0.184131 Jun 01 04:34:54.960317 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 337/665] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:34:54 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1675 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:34:55.788330 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-433daad0-c0ae-462c-a95d-88d66d06dec0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:55.788895 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-433daad0-c0ae-462c-a95d-88d66d06dec0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:55.815098 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-433daad0-c0ae-462c-a95d-88d66d06dec0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:55.815646 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-433daad0-c0ae-462c-a95d-88d66d06dec0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:55.816467 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-433daad0-c0ae-462c-a95d-88d66d06dec0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:55.817109 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-433daad0-c0ae-462c-a95d-88d66d06dec0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:55.979068 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-474958e6-9acc-4af0-8151-f26787d2d2fc tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:55.981376 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-474958e6-9acc-4af0-8151-f26787d2d2fc tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:56.002234 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-433daad0-c0ae-462c-a95d-88d66d06dec0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:56.014062 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-474958e6-9acc-4af0-8151-f26787d2d2fc tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:56.014907 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-433daad0-c0ae-462c-a95d-88d66d06dec0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1688 microversion: 2.1 time: 0.232781 Jun 01 04:34:56.015053 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-474958e6-9acc-4af0-8151-f26787d2d2fc tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:56.016241 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 329/666] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:34:55 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1688 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:34:56.016390 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-474958e6-9acc-4af0-8151-f26787d2d2fc tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:56.019114 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-474958e6-9acc-4af0-8151-f26787d2d2fc tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:56.030336 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-bc09cc20-e4a2-4e79-98b0-fc0290274ebd tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:56.032012 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-bc09cc20-e4a2-4e79-98b0-fc0290274ebd tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:56.044233 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bc09cc20-e4a2-4e79-98b0-fc0290274ebd tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:56.045281 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bc09cc20-e4a2-4e79-98b0-fc0290274ebd tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:56.046302 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bc09cc20-e4a2-4e79-98b0-fc0290274ebd tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:56.049619 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bc09cc20-e4a2-4e79-98b0-fc0290274ebd tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:56.108783 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-bc09cc20-e4a2-4e79-98b0-fc0290274ebd tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] Going to try to terminate instance {{(pid=118517) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 01 04:34:56.258257 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-474958e6-9acc-4af0-8151-f26787d2d2fc tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:56.272897 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-474958e6-9acc-4af0-8151-f26787d2d2fc tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1675 microversion: 2.1 time: 0.299079 Jun 01 04:34:56.274883 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 338/667] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:34:55 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1675 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:34:56.463828 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-bc09cc20-e4a2-4e79-98b0-fc0290274ebd tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e" status: 204 len: 0 microversion: 2.1 time: 0.443142 Jun 01 04:34:56.465180 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 330/668] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 1 04:34:56 2022] DELETE /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 01 04:34:56.477088 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-48e18597-816e-4755-958e-ab6d3805be4f tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:56.478010 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-48e18597-816e-4755-958e-ab6d3805be4f tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:56.489749 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-48e18597-816e-4755-958e-ab6d3805be4f tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:56.490220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-48e18597-816e-4755-958e-ab6d3805be4f tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:56.491027 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-48e18597-816e-4755-958e-ab6d3805be4f tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:56.491521 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-48e18597-816e-4755-958e-ab6d3805be4f tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:56.684328 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-48e18597-816e-4755-958e-ab6d3805be4f tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:56.696210 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-48e18597-816e-4755-958e-ab6d3805be4f tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e" status: 200 len: 1577 microversion: 2.1 time: 0.224018 Jun 01 04:34:56.697618 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 339/669] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:34:56 2022] GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e => generated 1577 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:34:57.041193 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-5b862f2b-e420-499d-a8b9-67ffba289a5b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:57.041193 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-5b862f2b-e420-499d-a8b9-67ffba289a5b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:57.044475 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5b862f2b-e420-499d-a8b9-67ffba289a5b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:57.045257 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5b862f2b-e420-499d-a8b9-67ffba289a5b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:57.046302 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5b862f2b-e420-499d-a8b9-67ffba289a5b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:57.047537 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5b862f2b-e420-499d-a8b9-67ffba289a5b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:57.158227 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-5b862f2b-e420-499d-a8b9-67ffba289a5b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:57.172185 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-5b862f2b-e420-499d-a8b9-67ffba289a5b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1620 microversion: 2.1 time: 0.142626 Jun 01 04:34:57.182284 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 331/670] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:34:57 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1620 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:34:57.294017 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-e37484b0-8128-409b-8d58-b78558a86d58 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:57.294786 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-e37484b0-8128-409b-8d58-b78558a86d58 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:57.301468 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e37484b0-8128-409b-8d58-b78558a86d58 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:57.313013 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e37484b0-8128-409b-8d58-b78558a86d58 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:57.313013 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e37484b0-8128-409b-8d58-b78558a86d58 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:57.313013 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e37484b0-8128-409b-8d58-b78558a86d58 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:57.313013 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:57.629750 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-e37484b0-8128-409b-8d58-b78558a86d58 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:57.632285 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-cb96ca7d-fc07-42bb-869f-7e0eec0270d4 req-8f6c3524-848d-47d9-bcbb-6ed2c25470b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f8eae96-794e-4cdb-a397-0f892e3fd9f0", "name": "network-vif-deleted", "tag": "ca205306-46cb-4b2c-ad84-b2f690075069"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:34:57.648488 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-cb96ca7d-fc07-42bb-869f-7e0eec0270d4 req-8f6c3524-848d-47d9-bcbb-6ed2c25470b7 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:57.648945 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-cb96ca7d-fc07-42bb-869f-7e0eec0270d4 req-8f6c3524-848d-47d9-bcbb-6ed2c25470b7 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:57.650591 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-e37484b0-8128-409b-8d58-b78558a86d58 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1675 microversion: 2.1 time: 0.361651 Jun 01 04:34:57.652307 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 340/671] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:34:57 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1675 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:34:57.676332 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-cb96ca7d-fc07-42bb-869f-7e0eec0270d4 req-8f6c3524-848d-47d9-bcbb-6ed2c25470b7 service nova] Creating event network-vif-deleted:ca205306-46cb-4b2c-ad84-b2f690075069 for instance 9f8eae96-794e-4cdb-a397-0f892e3fd9f0 on hv-cinder-66710 Jun 01 04:34:57.682608 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-cb96ca7d-fc07-42bb-869f-7e0eec0270d4 req-8f6c3524-848d-47d9-bcbb-6ed2c25470b7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190143 Jun 01 04:34:57.683466 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 332/672] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:34:57.716049 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-7031a9a6-b98a-4acb-8e0d-4599a0e93e03 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:57.716985 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-7031a9a6-b98a-4acb-8e0d-4599a0e93e03 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:57.724715 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7031a9a6-b98a-4acb-8e0d-4599a0e93e03 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:57.725170 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7031a9a6-b98a-4acb-8e0d-4599a0e93e03 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:57.726079 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7031a9a6-b98a-4acb-8e0d-4599a0e93e03 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:57.726387 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7031a9a6-b98a-4acb-8e0d-4599a0e93e03 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:57.902369 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-7031a9a6-b98a-4acb-8e0d-4599a0e93e03 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:57.913140 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-7031a9a6-b98a-4acb-8e0d-4599a0e93e03 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e" status: 200 len: 1577 microversion: 2.1 time: 0.201813 Jun 01 04:34:57.914317 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 341/673] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:34:57 2022] GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e => generated 1577 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:34:58.190906 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-fb496c68-31fd-4a68-8e3c-9323277ab78b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:58.191649 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-fb496c68-31fd-4a68-8e3c-9323277ab78b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:58.212050 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-fb496c68-31fd-4a68-8e3c-9323277ab78b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:58.212911 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-fb496c68-31fd-4a68-8e3c-9323277ab78b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:58.213949 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-fb496c68-31fd-4a68-8e3c-9323277ab78b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:58.214697 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-fb496c68-31fd-4a68-8e3c-9323277ab78b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:58.219539 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:58.304620 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-fb496c68-31fd-4a68-8e3c-9323277ab78b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:58.307847 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-fb496c68-31fd-4a68-8e3c-9323277ab78b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:58.309273 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.objects.instance [None req-fb496c68-31fd-4a68-8e3c-9323277ab78b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lazy-loading 'fault' on Instance uuid 9f8eae96-794e-4cdb-a397-0f892e3fd9f0 {{(pid=118517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:34:58.383997 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-fb496c68-31fd-4a68-8e3c-9323277ab78b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:58.395941 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-fb496c68-31fd-4a68-8e3c-9323277ab78b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 200 len: 1335 microversion: 2.1 time: 0.208207 Jun 01 04:34:58.396560 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 333/674] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:34:58 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 1335 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:34:58.672396 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-052fb3cc-53a3-4ae1-9e92-9b4ed829e25e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:58.673566 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-052fb3cc-53a3-4ae1-9e92-9b4ed829e25e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:58.693216 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-052fb3cc-53a3-4ae1-9e92-9b4ed829e25e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:58.696603 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-052fb3cc-53a3-4ae1-9e92-9b4ed829e25e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:58.701031 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-052fb3cc-53a3-4ae1-9e92-9b4ed829e25e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:58.701645 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-052fb3cc-53a3-4ae1-9e92-9b4ed829e25e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:58.931286 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-34dd72a6-5cff-4e38-8d34-af452424221c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:58.932037 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-34dd72a6-5cff-4e38-8d34-af452424221c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:58.941551 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-34dd72a6-5cff-4e38-8d34-af452424221c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:58.943603 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-34dd72a6-5cff-4e38-8d34-af452424221c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:58.944545 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-34dd72a6-5cff-4e38-8d34-af452424221c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:58.948604 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-34dd72a6-5cff-4e38-8d34-af452424221c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:59.064755 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-052fb3cc-53a3-4ae1-9e92-9b4ed829e25e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:59.084833 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-052fb3cc-53a3-4ae1-9e92-9b4ed829e25e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1675 microversion: 2.1 time: 0.417899 Jun 01 04:34:59.085677 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 342/675] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:34:58 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1675 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:34:59.347348 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-34dd72a6-5cff-4e38-8d34-af452424221c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:34:59.374446 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-04d3fb0e-59f4-4770-9fa4-9bb037da1738 req-c263b41b-306f-46db-8a7e-ec7e44d40a0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a724f928-21b8-4379-a078-600dc46ce06e", "name": "network-vif-unplugged", "status": "completed", "tag": "52757b70-1a8f-4bea-8511-23d4b4a70ddf"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:34:59.377740 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-34dd72a6-5cff-4e38-8d34-af452424221c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e" status: 200 len: 1577 microversion: 2.1 time: 0.449866 Jun 01 04:34:59.381836 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 334/676] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:34:58 2022] GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e => generated 1577 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:34:59.400032 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-04d3fb0e-59f4-4770-9fa4-9bb037da1738 req-c263b41b-306f-46db-8a7e-ec7e44d40a0a service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:59.402129 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-04d3fb0e-59f4-4770-9fa4-9bb037da1738 req-c263b41b-306f-46db-8a7e-ec7e44d40a0a service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:59.412851 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-47dd7443-7740-433c-a9c7-b39f94679046 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:59.413692 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-47dd7443-7740-433c-a9c7-b39f94679046 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 9f8eae96-794e-4cdb-a397-0f892e3fd9f0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:34:59.423187 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-47dd7443-7740-433c-a9c7-b39f94679046 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:59.426481 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-47dd7443-7740-433c-a9c7-b39f94679046 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:59.428172 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-47dd7443-7740-433c-a9c7-b39f94679046 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:34:59.431971 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-47dd7443-7740-433c-a9c7-b39f94679046 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:34:59.453938 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-04d3fb0e-59f4-4770-9fa4-9bb037da1738 req-c263b41b-306f-46db-8a7e-ec7e44d40a0a service nova] Creating event network-vif-unplugged:52757b70-1a8f-4bea-8511-23d4b4a70ddf for instance a724f928-21b8-4379-a078-600dc46ce06e on hv-cinder-66710 Jun 01 04:34:59.470158 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-04d3fb0e-59f4-4770-9fa4-9bb037da1738 req-c263b41b-306f-46db-8a7e-ec7e44d40a0a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100213 Jun 01 04:34:59.477376 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 343/677] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:34:59.485926 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.wsgi [None req-47dd7443-7740-433c-a9c7-b39f94679046 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] HTTP exception thrown: Instance 9f8eae96-794e-4cdb-a397-0f892e3fd9f0 could not be found. Jun 01 04:34:59.489521 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-47dd7443-7740-433c-a9c7-b39f94679046 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Request method failure captured: Jun 01 04:34:59.489521 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: request: GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 HTTP/1.1 Jun 01 04:34:59.489521 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept: application/json Jun 01 04:34:59.489521 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept-Encoding: identity Jun 01 04:34:59.489521 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Connection: close Jun 01 04:34:59.489521 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Length: 0 Jun 01 04:34:59.489521 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Type: application/json Jun 01 04:34:59.489521 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Host: 10.222.0.18 Jun 01 04:34:59.489521 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Openstack-System-Scope: None Jun 01 04:34:59.489521 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: User-Agent: python-urllib3/1.26.9 Jun 01 04:34:59.489521 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Auth-Token: gAAAAABiluq6EdglhZgXiS3poHNwL1UUlx7ueC5joJlWhxd9bYUqBcVhkRgghCVJtLC4e0wLqyaT33kVSWKLZMbzDI4PfCEcbl3WeLPmp8XhZ65e-9_afNsqAcBGQuzFEA_cFCtrXjwsuFGgJBYRijSPhwsG4KkGPRwDtmJAygQq6VRDVmLA8kk Jun 01 04:34:59.489521 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Id: None Jun 01 04:34:59.489521 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Name: None Jun 01 04:34:59.489521 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Identity-Status: Confirmed Jun 01 04:34:59.489521 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Is-Admin-Project: True Jun 01 04:34:59.489521 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Id: default Jun 01 04:34:59.489521 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Name: Default Jun 01 04:34:59.489521 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Id: bda53dca70e54e208b2767a833923234 Jun 01 04:34:59.489521 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-788108745 Jun 01 04:34:59.489521 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Role: reader,member Jun 01 04:34:59.489521 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Roles: reader,member Jun 01 04:34:59.490914 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bda53dca70e54e208b2767a833923234"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bda53dca70e54e208b2767a833923234"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bda53dca70e54e208b2767a833923234"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bda53dca70e54e208b2767a833923234"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:34:59.490914 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant: tempest-ServerRescueNegativeTestJSON-788108745 Jun 01 04:34:59.490914 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Id: bda53dca70e54e208b2767a833923234 Jun 01 04:34:59.490914 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-788108745 Jun 01 04:34:59.490914 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User: tempest-ServerRescueNegativeTestJSON-788108745-project Jun 01 04:34:59.490914 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Id: default Jun 01 04:34:59.490914 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Name: Default Jun 01 04:34:59.490914 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Id: 12816eca659542af9e41b92fdb674eab Jun 01 04:34:59.490914 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Name: tempest-ServerRescueNegativeTestJSON-788108745-project Jun 01 04:34:59.490914 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: method: > Jun 01 04:34:59.490914 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: exception: Instance 9f8eae96-794e-4cdb-a397-0f892e3fd9f0 could not be found. Jun 01 04:34:59.490914 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: action_args: {'id': '9f8eae96-794e-4cdb-a397-0f892e3fd9f0'} Jun 01 04:34:59.497725 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:34:59.497725 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:34:59.497725 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:34:59.497725 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:34:59.497725 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:34:59.497725 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:34:59.497725 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:34:59.497725 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:34:59.497725 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:34:59.497725 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:34:59.497725 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f8eae96-794e-4cdb-a397-0f892e3fd9f0 could not be found. Jun 01 04:34:59.497725 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:34:59.497725 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:34:59.497725 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:34:59.497725 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:34:59.497725 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:34:59.497725 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:34:59.497725 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:34:59.497725 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:34:59.497725 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:34:59.499003 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:34:59.499003 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 01 04:34:59.499003 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 01 04:34:59.499003 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:34:59.499003 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:34:59.499003 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:34:59.499003 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:34:59.499003 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f8eae96-794e-4cdb-a397-0f892e3fd9f0 could not be found. Jun 01 04:34:59.499003 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:34:59.499003 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:34:59.499003 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:34:59.499003 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:34:59.499003 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:34:59.499003 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:34:59.499003 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:34:59.499003 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:34:59.499003 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f8eae96-794e-4cdb-a397-0f892e3fd9f0 could not be found. Jun 01 04:34:59.499003 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:34:59.501562 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-47dd7443-7740-433c-a9c7-b39f94679046 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Returning 404 to user: Instance 9f8eae96-794e-4cdb-a397-0f892e3fd9f0 could not be found. {{(pid=118517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:34:59.501562 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-47dd7443-7740-433c-a9c7-b39f94679046 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0" status: 404 len: 111 microversion: 2.1 time: 0.086242 Jun 01 04:34:59.501562 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 335/678] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:34:59 2022] GET /compute/v2.1/servers/9f8eae96-794e-4cdb-a397-0f892e3fd9f0 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:34:59.505899 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d3a82350-d267-47a7-afb2-2e4034e73cc0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '.version_select at 0x7ff3258d9040>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:34:59.585433 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-d3a82350-d267-47a7-afb2-2e4034e73cc0 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1101798254" status: 202 len: 0 microversion: 2.1 time: 0.083916 Jun 01 04:34:59.592863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 344/679] 10.222.0.18 () {58 vars in 1220 bytes} [Wed Jun 1 04:34:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1101798254 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 01 04:35:00.103177 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-3864511a-f673-45e3-9d8c-ecd9f16021db tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:00.104021 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-3864511a-f673-45e3-9d8c-ecd9f16021db tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:00.119061 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3864511a-f673-45e3-9d8c-ecd9f16021db tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:00.119522 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3864511a-f673-45e3-9d8c-ecd9f16021db tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:00.130929 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3864511a-f673-45e3-9d8c-ecd9f16021db tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:00.131496 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3864511a-f673-45e3-9d8c-ecd9f16021db tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:00.403145 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-0a9f312b-5104-44db-8fe2-3013ab0a1bcd tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:00.403936 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-0a9f312b-5104-44db-8fe2-3013ab0a1bcd tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:00.426330 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0a9f312b-5104-44db-8fe2-3013ab0a1bcd tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:00.427003 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0a9f312b-5104-44db-8fe2-3013ab0a1bcd tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:00.427852 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0a9f312b-5104-44db-8fe2-3013ab0a1bcd tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:00.428298 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0a9f312b-5104-44db-8fe2-3013ab0a1bcd tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:00.525847 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-0a9f312b-5104-44db-8fe2-3013ab0a1bcd tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:00.535990 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-0a9f312b-5104-44db-8fe2-3013ab0a1bcd tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e" status: 200 len: 1510 microversion: 2.1 time: 0.142336 Jun 01 04:35:00.537808 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 345/680] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:00 2022] GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e => generated 1510 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:00.665745 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-3864511a-f673-45e3-9d8c-ecd9f16021db tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:00.678857 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-3864511a-f673-45e3-9d8c-ecd9f16021db tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1675 microversion: 2.1 time: 0.580501 Jun 01 04:35:00.680166 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 336/681] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:00 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1675 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:01.014694 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-7a7c161c-4044-43e6-bdfb-239b201fbfd8 req-54960ebc-771c-4f6e-afef-d2e86617e1c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a724f928-21b8-4379-a078-600dc46ce06e", "name": "network-vif-deleted", "tag": "52757b70-1a8f-4bea-8511-23d4b4a70ddf"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:35:01.038519 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-7a7c161c-4044-43e6-bdfb-239b201fbfd8 req-54960ebc-771c-4f6e-afef-d2e86617e1c5 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:01.039635 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-7a7c161c-4044-43e6-bdfb-239b201fbfd8 req-54960ebc-771c-4f6e-afef-d2e86617e1c5 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:01.056600 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-7a7c161c-4044-43e6-bdfb-239b201fbfd8 req-54960ebc-771c-4f6e-afef-d2e86617e1c5 service nova] Creating event network-vif-deleted:52757b70-1a8f-4bea-8511-23d4b4a70ddf for instance a724f928-21b8-4379-a078-600dc46ce06e on hv-cinder-66710 Jun 01 04:35:01.068126 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-7a7c161c-4044-43e6-bdfb-239b201fbfd8 req-54960ebc-771c-4f6e-afef-d2e86617e1c5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057592 Jun 01 04:35:01.069774 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 346/682] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:35:01.554728 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a10a42a4-624f-4ad1-854b-3f6009b76940 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:01.555368 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-a10a42a4-624f-4ad1-854b-3f6009b76940 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:01.562922 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a10a42a4-624f-4ad1-854b-3f6009b76940 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:01.563912 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a10a42a4-624f-4ad1-854b-3f6009b76940 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:01.564915 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a10a42a4-624f-4ad1-854b-3f6009b76940 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:01.565557 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a10a42a4-624f-4ad1-854b-3f6009b76940 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:01.697755 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-3f13a99c-9379-4ad9-9b4e-9725a3c66ed1 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:01.704957 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-3f13a99c-9379-4ad9-9b4e-9725a3c66ed1 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:01.720693 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3f13a99c-9379-4ad9-9b4e-9725a3c66ed1 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:01.732805 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-a10a42a4-624f-4ad1-854b-3f6009b76940 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:01.734766 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3f13a99c-9379-4ad9-9b4e-9725a3c66ed1 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:01.735998 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3f13a99c-9379-4ad9-9b4e-9725a3c66ed1 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:01.736450 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3f13a99c-9379-4ad9-9b4e-9725a3c66ed1 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:01.746746 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-a10a42a4-624f-4ad1-854b-3f6009b76940 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e" status: 200 len: 1226 microversion: 2.1 time: 0.196484 Jun 01 04:35:01.747741 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 337/683] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:01 2022] GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e => generated 1226 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:01.978367 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-3f13a99c-9379-4ad9-9b4e-9725a3c66ed1 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:01.988218 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-3f13a99c-9379-4ad9-9b4e-9725a3c66ed1 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1675 microversion: 2.1 time: 0.294775 Jun 01 04:35:01.989989 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 347/684] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:01 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1675 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:02.764617 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-7ea47443-c00a-4e2b-9eb0-9730bb8ea83b tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:02.765372 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-7ea47443-c00a-4e2b-9eb0-9730bb8ea83b tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:02.772245 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7ea47443-c00a-4e2b-9eb0-9730bb8ea83b tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:02.777006 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7ea47443-c00a-4e2b-9eb0-9730bb8ea83b tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:02.777006 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7ea47443-c00a-4e2b-9eb0-9730bb8ea83b tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:02.777006 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7ea47443-c00a-4e2b-9eb0-9730bb8ea83b tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:02.805666 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7ea47443-c00a-4e2b-9eb0-9730bb8ea83b tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:02.806128 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7ea47443-c00a-4e2b-9eb0-9730bb8ea83b tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:02.806583 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.objects.instance [None req-7ea47443-c00a-4e2b-9eb0-9730bb8ea83b tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lazy-loading 'fault' on Instance uuid a724f928-21b8-4379-a078-600dc46ce06e {{(pid=118517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:35:02.852311 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-7ea47443-c00a-4e2b-9eb0-9730bb8ea83b tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:02.857231 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-7ea47443-c00a-4e2b-9eb0-9730bb8ea83b tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e" status: 200 len: 1231 microversion: 2.1 time: 0.096650 Jun 01 04:35:02.857797 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 338/685] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:02 2022] GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e => generated 1231 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:03.007162 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b65f923e-808b-453c-b784-ed3052120b8f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:03.007993 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-b65f923e-808b-453c-b784-ed3052120b8f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:03.010755 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:35:03.016493 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b65f923e-808b-453c-b784-ed3052120b8f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:03.016951 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b65f923e-808b-453c-b784-ed3052120b8f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:03.017974 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b65f923e-808b-453c-b784-ed3052120b8f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:03.018418 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b65f923e-808b-453c-b784-ed3052120b8f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:03.192853 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b65f923e-808b-453c-b784-ed3052120b8f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:03.203434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-b65f923e-808b-453c-b784-ed3052120b8f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1652 microversion: 2.1 time: 0.200673 Jun 01 04:35:03.204019 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 348/686] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:03 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1652 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:03.221117 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-87733515-1e49-4d30-960f-2a1f2b8cab4e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:35:03.228762 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-87733515-1e49-4d30-960f-2a1f2b8cab4e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:03.233157 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-87733515-1e49-4d30-960f-2a1f2b8cab4e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:03.253967 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-87733515-1e49-4d30-960f-2a1f2b8cab4e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Going to try to start instance {{(pid=118517) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 01 04:35:03.459802 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-87733515-1e49-4d30-960f-2a1f2b8cab4e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "POST /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95/action" status: 202 len: 0 microversion: 2.1 time: 0.243038 Jun 01 04:35:03.460421 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 339/687] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 1 04:35:03 2022] POST /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 01 04:35:03.472683 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-fe8dfb78-0060-4160-8209-8d8a80d5efd9 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:03.481603 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-fe8dfb78-0060-4160-8209-8d8a80d5efd9 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:03.491937 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fe8dfb78-0060-4160-8209-8d8a80d5efd9 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:03.492766 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fe8dfb78-0060-4160-8209-8d8a80d5efd9 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:03.493849 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fe8dfb78-0060-4160-8209-8d8a80d5efd9 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:03.495000 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fe8dfb78-0060-4160-8209-8d8a80d5efd9 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:03.695826 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-fe8dfb78-0060-4160-8209-8d8a80d5efd9 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:03.707490 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-fe8dfb78-0060-4160-8209-8d8a80d5efd9 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1661 microversion: 2.1 time: 0.239354 Jun 01 04:35:03.707490 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 349/688] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:03 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1661 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:03.886418 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-03ceb2ed-753c-4828-b780-b2af1ebe22f2 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:03.901135 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-03ceb2ed-753c-4828-b780-b2af1ebe22f2 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:03.925722 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-03ceb2ed-753c-4828-b780-b2af1ebe22f2 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:03.926808 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-03ceb2ed-753c-4828-b780-b2af1ebe22f2 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:03.928416 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-03ceb2ed-753c-4828-b780-b2af1ebe22f2 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:03.929390 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-03ceb2ed-753c-4828-b780-b2af1ebe22f2 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:03.969036 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.wsgi [None req-03ceb2ed-753c-4828-b780-b2af1ebe22f2 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] HTTP exception thrown: Instance a724f928-21b8-4379-a078-600dc46ce06e could not be found. Jun 01 04:35:03.974186 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-03ceb2ed-753c-4828-b780-b2af1ebe22f2 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Request method failure captured: Jun 01 04:35:03.974186 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: request: GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e HTTP/1.1 Jun 01 04:35:03.974186 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept: application/json Jun 01 04:35:03.974186 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept-Encoding: identity Jun 01 04:35:03.974186 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Connection: close Jun 01 04:35:03.974186 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Length: 0 Jun 01 04:35:03.974186 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Type: application/json Jun 01 04:35:03.974186 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Host: 10.222.0.18 Jun 01 04:35:03.974186 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Openstack-System-Scope: None Jun 01 04:35:03.974186 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: User-Agent: python-urllib3/1.26.9 Jun 01 04:35:03.974186 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Auth-Token: gAAAAABilutmTuyqS9Q91ukdOnAjeU1dbTEQWa_t446Wl_uDjLoasN5Z33XdElRzzBdbMU0zO5IX31ix1vxYsAXmHYhfLPxNvuSwl0cyKLqqTZIi3wL_DQLWF21szLxLN53GzX9arTaIyPatIq4sLhTVbXl4sNVIIlvQ1gS_cTNbnQSq5AO5Pxo Jun 01 04:35:03.974186 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Id: None Jun 01 04:35:03.974186 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Name: None Jun 01 04:35:03.974186 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Identity-Status: Confirmed Jun 01 04:35:03.974186 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Is-Admin-Project: True Jun 01 04:35:03.974186 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Id: default Jun 01 04:35:03.974186 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Name: Default Jun 01 04:35:03.974186 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Id: 9369d530285849b3a9eac5e0034d3170 Jun 01 04:35:03.974186 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Name: tempest-TestVolumeBootPattern-161219860 Jun 01 04:35:03.974186 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Role: reader,member Jun 01 04:35:03.974186 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Roles: reader,member Jun 01 04:35:03.981515 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9369d530285849b3a9eac5e0034d3170"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9369d530285849b3a9eac5e0034d3170"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9369d530285849b3a9eac5e0034d3170"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9369d530285849b3a9eac5e0034d3170"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:35:03.981515 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant: tempest-TestVolumeBootPattern-161219860 Jun 01 04:35:03.981515 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Id: 9369d530285849b3a9eac5e0034d3170 Jun 01 04:35:03.981515 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Name: tempest-TestVolumeBootPattern-161219860 Jun 01 04:35:03.981515 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User: tempest-TestVolumeBootPattern-161219860-project Jun 01 04:35:03.981515 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Id: default Jun 01 04:35:03.981515 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Name: Default Jun 01 04:35:03.981515 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Id: c052b2f518064843928b4eff569e913f Jun 01 04:35:03.981515 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Name: tempest-TestVolumeBootPattern-161219860-project Jun 01 04:35:03.981515 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: method: > Jun 01 04:35:03.981515 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: exception: Instance a724f928-21b8-4379-a078-600dc46ce06e could not be found. Jun 01 04:35:03.981515 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: action_args: {'id': 'a724f928-21b8-4379-a078-600dc46ce06e'} Jun 01 04:35:03.982488 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:35:03.982488 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:35:03.982488 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:35:03.982488 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:35:03.982488 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:35:03.982488 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:35:03.982488 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:35:03.982488 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:35:03.982488 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:35:03.982488 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:35:03.982488 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a724f928-21b8-4379-a078-600dc46ce06e could not be found. Jun 01 04:35:03.982488 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:35:03.982488 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:35:03.982488 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:35:03.982488 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:35:03.982488 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:35:03.982488 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:35:03.982488 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:35:03.982488 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:35:03.982488 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:35:03.984550 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:35:03.984550 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 01 04:35:03.984550 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 01 04:35:03.984550 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:35:03.984550 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:35:03.984550 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:35:03.984550 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:35:03.984550 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a724f928-21b8-4379-a078-600dc46ce06e could not be found. Jun 01 04:35:03.984550 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:35:03.984550 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:35:03.984550 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:35:03.984550 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:35:03.984550 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:35:03.984550 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:35:03.984550 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:35:03.984550 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:35:03.984550 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a724f928-21b8-4379-a078-600dc46ce06e could not be found. Jun 01 04:35:03.984550 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:35:03.987291 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-03ceb2ed-753c-4828-b780-b2af1ebe22f2 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Returning 404 to user: Instance a724f928-21b8-4379-a078-600dc46ce06e could not be found. {{(pid=118517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:35:03.987291 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-03ceb2ed-753c-4828-b780-b2af1ebe22f2 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e" status: 404 len: 111 microversion: 2.1 time: 0.097444 Jun 01 04:35:03.987291 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 340/689] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:03 2022] GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:35:04.084637 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-ad282c63-6f43-47d1-b12b-b94175b6157f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:04.085178 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-ad282c63-6f43-47d1-b12b-b94175b6157f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:04.094328 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ad282c63-6f43-47d1-b12b-b94175b6157f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:04.094781 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ad282c63-6f43-47d1-b12b-b94175b6157f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:04.095600 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ad282c63-6f43-47d1-b12b-b94175b6157f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:04.096032 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ad282c63-6f43-47d1-b12b-b94175b6157f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:04.122620 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-d5a03fe2-d8d5-44f1-b5bb-5b00aca9c7ea tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-113951491", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1514032961", "security_groups": [{"name": "tempest-secgroup-smoke-799074218"}], "block_device_mapping_v2": [{"uuid": "7b8e0ca5-93c7-47dc-aa39-3cd3175028c7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e3dc963a-6f83-4418-ad4a-91353c23b06d"}]}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:35:04.130902 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-ad282c63-6f43-47d1-b12b-b94175b6157f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Going to try to terminate instance {{(pid=118516) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 01 04:35:04.286268 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.network.neutron [None req-d5a03fe2-d8d5-44f1-b5bb-5b00aca9c7ea tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] validate_networks() for [('e3dc963a-6f83-4418-ad4a-91353c23b06d', None, None, None, None, None)] {{(pid=118517) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 01 04:35:04.463988 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-ad282c63-6f43-47d1-b12b-b94175b6157f tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 204 len: 0 microversion: 2.1 time: 0.382948 Jun 01 04:35:04.467461 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 350/690] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 1 04:35:04 2022] DELETE /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 01 04:35:04.473587 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-76e530e3-8dc0-4553-a1b3-d309f2ee9b9b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:04.474708 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-76e530e3-8dc0-4553-a1b3-d309f2ee9b9b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:04.483580 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-76e530e3-8dc0-4553-a1b3-d309f2ee9b9b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:04.484728 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-76e530e3-8dc0-4553-a1b3-d309f2ee9b9b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:04.485924 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-76e530e3-8dc0-4553-a1b3-d309f2ee9b9b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:04.486452 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-76e530e3-8dc0-4553-a1b3-d309f2ee9b9b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:04.650213 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-76e530e3-8dc0-4553-a1b3-d309f2ee9b9b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:04.661398 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-76e530e3-8dc0-4553-a1b3-d309f2ee9b9b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1508 microversion: 2.1 time: 0.191489 Jun 01 04:35:04.663448 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 351/691] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:04 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1508 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:04.723557 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b4a8826d-3191-4df4-bfda-003a80ba1bed tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:04.726539 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-b4a8826d-3191-4df4-bfda-003a80ba1bed tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:04.738421 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b4a8826d-3191-4df4-bfda-003a80ba1bed tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:04.739165 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b4a8826d-3191-4df4-bfda-003a80ba1bed tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:04.740232 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b4a8826d-3191-4df4-bfda-003a80ba1bed tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:04.740749 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b4a8826d-3191-4df4-bfda-003a80ba1bed tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:04.929298 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b4a8826d-3191-4df4-bfda-003a80ba1bed tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:04.938548 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-b4a8826d-3191-4df4-bfda-003a80ba1bed tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1661 microversion: 2.1 time: 0.218841 Jun 01 04:35:04.941463 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 352/692] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:04 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1661 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:05.029560 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-d5a03fe2-d8d5-44f1-b5bb-5b00aca9c7ea tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Flavor limits 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 01 04:35:05.030522 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-d5a03fe2-d8d5-44f1-b5bb-5b00aca9c7ea tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Image limits 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 01 04:35:05.032765 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-d5a03fe2-d8d5-44f1-b5bb-5b00aca9c7ea tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Flavor pref 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 01 04:35:05.032765 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-d5a03fe2-d8d5-44f1-b5bb-5b00aca9c7ea tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Image pref 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 01 04:35:05.032765 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-d5a03fe2-d8d5-44f1-b5bb-5b00aca9c7ea tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 01 04:35:05.041925 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d5a03fe2-d8d5-44f1-b5bb-5b00aca9c7ea tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:05.042751 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d5a03fe2-d8d5-44f1-b5bb-5b00aca9c7ea tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:05.043621 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d5a03fe2-d8d5-44f1-b5bb-5b00aca9c7ea tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:05.044067 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d5a03fe2-d8d5-44f1-b5bb-5b00aca9c7ea tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:05.062788 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.quota [None req-d5a03fe2-d8d5-44f1-b5bb-5b00aca9c7ea tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Getting quotas for project 9369d530285849b3a9eac5e0034d3170. Resources: {'ram', 'instances', 'cores'} {{(pid=118517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:35:05.066804 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.quota [None req-d5a03fe2-d8d5-44f1-b5bb-5b00aca9c7ea tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Getting quotas for user c052b2f518064843928b4eff569e913f and project 9369d530285849b3a9eac5e0034d3170. Resources: {'ram', 'instances', 'cores'} {{(pid=118517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:35:05.133604 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-d5a03fe2-d8d5-44f1-b5bb-5b00aca9c7ea tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Going to run 1 instances... {{(pid=118517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 01 04:35:05.135736 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-d5a03fe2-d8d5-44f1-b5bb-5b00aca9c7ea tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7b8e0ca5-93c7-47dc-aa39-3cd3175028c7',volume_size=None,volume_type=None)] {{(pid=118517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 01 04:35:05.601639 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-d5a03fe2-d8d5-44f1-b5bb-5b00aca9c7ea tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.478524 Jun 01 04:35:05.602492 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 341/693] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 1 04:35:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 1485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 01 04:35:05.617160 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-83544cb2-a397-41ab-b365-358d6a35c56d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:05.618396 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-83544cb2-a397-41ab-b365-358d6a35c56d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:05.681981 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-5a80ee07-ac72-4616-b22d-6d98456a821b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:05.682601 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-5a80ee07-ac72-4616-b22d-6d98456a821b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:05.696793 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5a80ee07-ac72-4616-b22d-6d98456a821b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:05.697124 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5a80ee07-ac72-4616-b22d-6d98456a821b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:05.697927 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5a80ee07-ac72-4616-b22d-6d98456a821b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:05.698354 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5a80ee07-ac72-4616-b22d-6d98456a821b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:05.704611 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-83544cb2-a397-41ab-b365-358d6a35c56d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:05.715483 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-83544cb2-a397-41ab-b365-358d6a35c56d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1094 microversion: 2.1 time: 0.106597 Jun 01 04:35:05.725585 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 353/694] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:05 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1094 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:05.937415 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-5a80ee07-ac72-4616-b22d-6d98456a821b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:05.946487 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-5a80ee07-ac72-4616-b22d-6d98456a821b tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1508 microversion: 2.1 time: 0.270323 Jun 01 04:35:05.946908 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 342/695] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:05 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1508 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:35:05.960443 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-2d465e2d-55dd-45ba-bbf3-49c88512e825 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:05.961058 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-2d465e2d-55dd-45ba-bbf3-49c88512e825 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:05.969050 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2d465e2d-55dd-45ba-bbf3-49c88512e825 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:05.970049 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2d465e2d-55dd-45ba-bbf3-49c88512e825 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:05.971446 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2d465e2d-55dd-45ba-bbf3-49c88512e825 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:05.972348 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2d465e2d-55dd-45ba-bbf3-49c88512e825 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:06.126870 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-2d465e2d-55dd-45ba-bbf3-49c88512e825 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:06.134591 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-2d465e2d-55dd-45ba-bbf3-49c88512e825 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1665 microversion: 2.1 time: 0.180318 Jun 01 04:35:06.135196 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 354/696] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:05 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1665 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:06.672319 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-b5b66fd9-4cce-476e-bc58-6162788ad877 req-d6ce6258-986a-4cc6-9369-af656ebefa42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b5c9f1-ba93-4279-91f7-048a6923868d", "name": "network-vif-deleted", "tag": "2e88e076-e176-494f-8401-4e2c11b64a89"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:35:06.683719 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-b5b66fd9-4cce-476e-bc58-6162788ad877 req-d6ce6258-986a-4cc6-9369-af656ebefa42 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:06.684930 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-b5b66fd9-4cce-476e-bc58-6162788ad877 req-d6ce6258-986a-4cc6-9369-af656ebefa42 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:06.702324 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-b5b66fd9-4cce-476e-bc58-6162788ad877 req-d6ce6258-986a-4cc6-9369-af656ebefa42 service nova] Creating event network-vif-deleted:2e88e076-e176-494f-8401-4e2c11b64a89 for instance d4b5c9f1-ba93-4279-91f7-048a6923868d on hv-cinder-66710 Jun 01 04:35:06.708448 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-b5b66fd9-4cce-476e-bc58-6162788ad877 req-d6ce6258-986a-4cc6-9369-af656ebefa42 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041616 Jun 01 04:35:06.709756 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 343/697] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:35:06.736367 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-ce3b28c1-33be-477d-9f69-be1225582515 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:06.736988 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-ce3b28c1-33be-477d-9f69-be1225582515 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:06.806336 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-ce3b28c1-33be-477d-9f69-be1225582515 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:06.815784 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-ce3b28c1-33be-477d-9f69-be1225582515 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1094 microversion: 2.1 time: 0.084867 Jun 01 04:35:06.827464 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 355/698] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:06 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1094 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:06.963846 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-4d7b1b5b-8787-4f5b-a13b-ca5376db5abf tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:06.964554 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-4d7b1b5b-8787-4f5b-a13b-ca5376db5abf tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:06.972743 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4d7b1b5b-8787-4f5b-a13b-ca5376db5abf tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:06.973455 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4d7b1b5b-8787-4f5b-a13b-ca5376db5abf tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:06.974245 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4d7b1b5b-8787-4f5b-a13b-ca5376db5abf tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:06.974688 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4d7b1b5b-8787-4f5b-a13b-ca5376db5abf tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:07.055392 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-4d7b1b5b-8787-4f5b-a13b-ca5376db5abf tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:07.064087 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-4d7b1b5b-8787-4f5b-a13b-ca5376db5abf tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 200 len: 1293 microversion: 2.1 time: 0.104824 Jun 01 04:35:07.064765 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 344/699] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:06 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 1293 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:07.517927 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-81bb535f-b52d-4dd4-8327-7de7d1837d47 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Action: 'create', calling method: .version_select at 0x7ff3259a8280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-117631107", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwkc5eivaA9v4OP8zswgzmnUNrHkd2+Zxjn0nCclu6gyrc5MHgQu3MKi0MBe/0bX6Yqys76JcYVSqvEV+fwH7qpoRsDUWqITGYg32d5rkEZD6lu8ZVHJiq+vQvwJpScxg=="}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:35:07.533166 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-81bb535f-b52d-4dd4-8327-7de7d1837d47 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Getting quotas for project cd5966396128491d814472e980cfd873. Resources: {'key_pairs'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:35:07.537166 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-81bb535f-b52d-4dd4-8327-7de7d1837d47 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Getting quotas for user 43b1ece3cb2e4fd6aa2d711bdff92dce and project cd5966396128491d814472e980cfd873. Resources: {'key_pairs'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:35:07.641014 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-81bb535f-b52d-4dd4-8327-7de7d1837d47 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.126232 Jun 01 04:35:07.642097 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 356/700] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jun 1 04:35:07 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:35:07.692274 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-23c5f87d-9e56-46d0-8135-b66c20c1a802 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1369114756", "imageRef": "ef3dc174-e85e-45d8-98a7-03fb97bc3982", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-117631107", "networks": [{"uuid": "11607d63-d036-4ed9-83f8-7655c1e3f472"}]}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:35:07.746483 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.network.neutron [None req-23c5f87d-9e56-46d0-8135-b66c20c1a802 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] validate_networks() for [('11607d63-d036-4ed9-83f8-7655c1e3f472', None, None, None, None, None)] {{(pid=118517) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 01 04:35:07.835833 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-c82556f6-0551-490b-8f36-3a4d3b1a6268 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:07.837097 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-c82556f6-0551-490b-8f36-3a4d3b1a6268 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:07.844128 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c82556f6-0551-490b-8f36-3a4d3b1a6268 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:07.844838 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c82556f6-0551-490b-8f36-3a4d3b1a6268 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:07.849637 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c82556f6-0551-490b-8f36-3a4d3b1a6268 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:07.849637 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c82556f6-0551-490b-8f36-3a4d3b1a6268 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:07.912149 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-c82556f6-0551-490b-8f36-3a4d3b1a6268 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:07.919682 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-c82556f6-0551-490b-8f36-3a4d3b1a6268 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1136 microversion: 2.1 time: 0.088519 Jun 01 04:35:07.927281 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 357/701] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:07 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1136 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:08.083120 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d0c9cce3-4de4-436f-b3e6-bb8c9b8c9d17 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:08.084182 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-d0c9cce3-4de4-436f-b3e6-bb8c9b8c9d17 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: d4b5c9f1-ba93-4279-91f7-048a6923868d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:08.095170 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d0c9cce3-4de4-436f-b3e6-bb8c9b8c9d17 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:08.099570 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d0c9cce3-4de4-436f-b3e6-bb8c9b8c9d17 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:08.099570 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d0c9cce3-4de4-436f-b3e6-bb8c9b8c9d17 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:08.099570 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d0c9cce3-4de4-436f-b3e6-bb8c9b8c9d17 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:08.117070 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.wsgi [None req-d0c9cce3-4de4-436f-b3e6-bb8c9b8c9d17 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] HTTP exception thrown: Instance d4b5c9f1-ba93-4279-91f7-048a6923868d could not be found. Jun 01 04:35:08.118797 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d0c9cce3-4de4-436f-b3e6-bb8c9b8c9d17 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Request method failure captured: Jun 01 04:35:08.118797 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: request: GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d HTTP/1.1 Jun 01 04:35:08.118797 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept: application/json Jun 01 04:35:08.118797 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept-Encoding: identity Jun 01 04:35:08.118797 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Connection: close Jun 01 04:35:08.118797 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Length: 0 Jun 01 04:35:08.118797 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Type: application/json Jun 01 04:35:08.118797 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Host: 10.222.0.18 Jun 01 04:35:08.118797 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Openstack-System-Scope: None Jun 01 04:35:08.118797 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: User-Agent: python-urllib3/1.26.9 Jun 01 04:35:08.118797 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Auth-Token: gAAAAABiluq6EdglhZgXiS3poHNwL1UUlx7ueC5joJlWhxd9bYUqBcVhkRgghCVJtLC4e0wLqyaT33kVSWKLZMbzDI4PfCEcbl3WeLPmp8XhZ65e-9_afNsqAcBGQuzFEA_cFCtrXjwsuFGgJBYRijSPhwsG4KkGPRwDtmJAygQq6VRDVmLA8kk Jun 01 04:35:08.118797 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Id: None Jun 01 04:35:08.118797 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Name: None Jun 01 04:35:08.118797 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Identity-Status: Confirmed Jun 01 04:35:08.118797 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Is-Admin-Project: True Jun 01 04:35:08.118797 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Id: default Jun 01 04:35:08.118797 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Name: Default Jun 01 04:35:08.118797 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Id: bda53dca70e54e208b2767a833923234 Jun 01 04:35:08.118797 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-788108745 Jun 01 04:35:08.118797 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Role: reader,member Jun 01 04:35:08.118797 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Roles: reader,member Jun 01 04:35:08.121108 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bda53dca70e54e208b2767a833923234"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bda53dca70e54e208b2767a833923234"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bda53dca70e54e208b2767a833923234"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bda53dca70e54e208b2767a833923234"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:35:08.121108 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant: tempest-ServerRescueNegativeTestJSON-788108745 Jun 01 04:35:08.121108 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Id: bda53dca70e54e208b2767a833923234 Jun 01 04:35:08.121108 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-788108745 Jun 01 04:35:08.121108 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User: tempest-ServerRescueNegativeTestJSON-788108745-project Jun 01 04:35:08.121108 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Id: default Jun 01 04:35:08.121108 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Name: Default Jun 01 04:35:08.121108 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Id: 12816eca659542af9e41b92fdb674eab Jun 01 04:35:08.121108 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Name: tempest-ServerRescueNegativeTestJSON-788108745-project Jun 01 04:35:08.121108 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: method: > Jun 01 04:35:08.121108 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: exception: Instance d4b5c9f1-ba93-4279-91f7-048a6923868d could not be found. Jun 01 04:35:08.121108 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: action_args: {'id': 'd4b5c9f1-ba93-4279-91f7-048a6923868d'} Jun 01 04:35:08.122657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:35:08.122657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:35:08.122657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:35:08.122657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:35:08.122657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:35:08.122657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:35:08.122657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:35:08.122657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:35:08.122657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:35:08.122657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:35:08.122657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4b5c9f1-ba93-4279-91f7-048a6923868d could not be found. Jun 01 04:35:08.122657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:35:08.122657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:35:08.122657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:35:08.122657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:35:08.122657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:35:08.122657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:35:08.122657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:35:08.122657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:35:08.122657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:35:08.124254 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:35:08.124254 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 01 04:35:08.124254 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 01 04:35:08.124254 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:35:08.124254 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:35:08.124254 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:35:08.124254 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:35:08.124254 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4b5c9f1-ba93-4279-91f7-048a6923868d could not be found. Jun 01 04:35:08.124254 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:35:08.124254 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:35:08.124254 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:35:08.124254 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:35:08.124254 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:35:08.124254 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:35:08.124254 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:35:08.124254 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:35:08.124254 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4b5c9f1-ba93-4279-91f7-048a6923868d could not be found. Jun 01 04:35:08.124254 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:35:08.127259 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d0c9cce3-4de4-436f-b3e6-bb8c9b8c9d17 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Returning 404 to user: Instance d4b5c9f1-ba93-4279-91f7-048a6923868d could not be found. {{(pid=118516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:35:08.127259 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-d0c9cce3-4de4-436f-b3e6-bb8c9b8c9d17 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d" status: 404 len: 111 microversion: 2.1 time: 0.042650 Jun 01 04:35:08.127259 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 358/702] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:08 2022] GET /compute/v2.1/servers/d4b5c9f1-ba93-4279-91f7-048a6923868d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 01 04:35:08.132082 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d0b35d60-9017-4b57-b2e4-97b5663fe9ce tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:08.132082 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-d0b35d60-9017-4b57-b2e4-97b5663fe9ce tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:08.138493 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d0b35d60-9017-4b57-b2e4-97b5663fe9ce tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:08.139138 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d0b35d60-9017-4b57-b2e4-97b5663fe9ce tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:08.141007 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d0b35d60-9017-4b57-b2e4-97b5663fe9ce tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:08.141799 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d0b35d60-9017-4b57-b2e4-97b5663fe9ce tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:08.169060 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-23c5f87d-9e56-46d0-8135-b66c20c1a802 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Flavor limits 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 01 04:35:08.169647 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-23c5f87d-9e56-46d0-8135-b66c20c1a802 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Image limits 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 01 04:35:08.170143 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-23c5f87d-9e56-46d0-8135-b66c20c1a802 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Flavor pref 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 01 04:35:08.170741 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-23c5f87d-9e56-46d0-8135-b66c20c1a802 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Image pref 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 01 04:35:08.171175 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-23c5f87d-9e56-46d0-8135-b66c20c1a802 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 01 04:35:08.179878 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-d0b35d60-9017-4b57-b2e4-97b5663fe9ce tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Going to try to terminate instance {{(pid=118516) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 01 04:35:08.184006 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-23c5f87d-9e56-46d0-8135-b66c20c1a802 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:08.184827 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-23c5f87d-9e56-46d0-8135-b66c20c1a802 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:08.186289 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-23c5f87d-9e56-46d0-8135-b66c20c1a802 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:08.187666 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-23c5f87d-9e56-46d0-8135-b66c20c1a802 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:08.209912 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.quota [None req-23c5f87d-9e56-46d0-8135-b66c20c1a802 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Getting quotas for project cd5966396128491d814472e980cfd873. Resources: {'ram', 'instances', 'cores'} {{(pid=118517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:35:08.216273 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.quota [None req-23c5f87d-9e56-46d0-8135-b66c20c1a802 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Getting quotas for user 43b1ece3cb2e4fd6aa2d711bdff92dce and project cd5966396128491d814472e980cfd873. Resources: {'ram', 'instances', 'cores'} {{(pid=118517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:35:08.227766 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-23c5f87d-9e56-46d0-8135-b66c20c1a802 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Going to run 1 instances... {{(pid=118517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 01 04:35:08.230010 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-23c5f87d-9e56-46d0-8135-b66c20c1a802 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef3dc174-e85e-45d8-98a7-03fb97bc3982',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 01 04:35:08.295127 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:35:08.328121 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-23c5f87d-9e56-46d0-8135-b66c20c1a802 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.638924 Jun 01 04:35:08.328727 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 345/703] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 1 04:35:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 01 04:35:08.338776 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-376d5826-b62f-4c25-b0bb-f763f12bd7b1 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:08.339449 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-376d5826-b62f-4c25-b0bb-f763f12bd7b1 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:08.347133 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:35:08.401165 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-376d5826-b62f-4c25-b0bb-f763f12bd7b1 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:08.409385 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-376d5826-b62f-4c25-b0bb-f763f12bd7b1 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1258 microversion: 2.1 time: 0.074644 Jun 01 04:35:08.410283 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 346/704] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:08 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:35:08.479277 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-d0b35d60-9017-4b57-b2e4-97b5663fe9ce tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 204 len: 0 microversion: 2.1 time: 0.353329 Jun 01 04:35:08.480182 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 359/705] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 1 04:35:08 2022] DELETE /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 01 04:35:08.492873 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-4d9691a0-31b3-43ef-8b27-193804ec6f88 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:08.494031 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-4d9691a0-31b3-43ef-8b27-193804ec6f88 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:08.502525 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4d9691a0-31b3-43ef-8b27-193804ec6f88 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:08.503146 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4d9691a0-31b3-43ef-8b27-193804ec6f88 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:08.504321 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4d9691a0-31b3-43ef-8b27-193804ec6f88 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:08.504813 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4d9691a0-31b3-43ef-8b27-193804ec6f88 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:08.643868 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-4d9691a0-31b3-43ef-8b27-193804ec6f88 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:08.651366 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-4d9691a0-31b3-43ef-8b27-193804ec6f88 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1521 microversion: 2.1 time: 0.162268 Jun 01 04:35:08.651930 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 347/706] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:08 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:08.938450 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-287d3bff-beae-49d1-baf4-73b6fb59679e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:08.939183 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-287d3bff-beae-49d1-baf4-73b6fb59679e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:08.946493 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-287d3bff-beae-49d1-baf4-73b6fb59679e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:08.947005 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-287d3bff-beae-49d1-baf4-73b6fb59679e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:08.947701 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-287d3bff-beae-49d1-baf4-73b6fb59679e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:08.948149 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-287d3bff-beae-49d1-baf4-73b6fb59679e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:09.016383 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-287d3bff-beae-49d1-baf4-73b6fb59679e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:09.023903 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-287d3bff-beae-49d1-baf4-73b6fb59679e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1200 microversion: 2.1 time: 0.090212 Jun 01 04:35:09.024488 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 360/707] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:08 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1200 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:09.427744 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-8ee9fbe1-3d34-4833-936f-c319a6428f8d tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:09.428339 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-8ee9fbe1-3d34-4833-936f-c319a6428f8d tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:09.515124 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-8ee9fbe1-3d34-4833-936f-c319a6428f8d tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:09.521859 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-8ee9fbe1-3d34-4833-936f-c319a6428f8d tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1258 microversion: 2.1 time: 0.099229 Jun 01 04:35:09.522595 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 348/708] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:09 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1258 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:35:09.670611 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-8bce1f47-ab4c-4528-844d-104cfde418b8 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:09.672324 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-8bce1f47-ab4c-4528-844d-104cfde418b8 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:09.679335 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8bce1f47-ab4c-4528-844d-104cfde418b8 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:09.683384 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8bce1f47-ab4c-4528-844d-104cfde418b8 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:09.683384 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8bce1f47-ab4c-4528-844d-104cfde418b8 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:09.683384 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8bce1f47-ab4c-4528-844d-104cfde418b8 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:09.823154 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-8bce1f47-ab4c-4528-844d-104cfde418b8 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:09.830119 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-8bce1f47-ab4c-4528-844d-104cfde418b8 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1521 microversion: 2.1 time: 0.165194 Jun 01 04:35:09.833848 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 361/709] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:09 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:10.042047 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-7b986d0f-08c9-4bf6-b536-4569550ae842 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:10.042923 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-7b986d0f-08c9-4bf6-b536-4569550ae842 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:10.050540 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7b986d0f-08c9-4bf6-b536-4569550ae842 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:10.051118 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7b986d0f-08c9-4bf6-b536-4569550ae842 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:10.052077 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7b986d0f-08c9-4bf6-b536-4569550ae842 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:10.052627 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7b986d0f-08c9-4bf6-b536-4569550ae842 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:10.458245 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-aab4ea6d-c15c-4817-bdc3-e3bcf8903813 req-d24af34b-4b7f-4028-bcbc-8e038c824cff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c4e6883-b6b6-408f-adb7-2b29610a2150", "name": "network-vif-deleted", "tag": "6fd6606f-c4cc-4fce-9771-e37ea15a7749"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:35:10.468728 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-aab4ea6d-c15c-4817-bdc3-e3bcf8903813 req-d24af34b-4b7f-4028-bcbc-8e038c824cff service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:10.469272 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-aab4ea6d-c15c-4817-bdc3-e3bcf8903813 req-d24af34b-4b7f-4028-bcbc-8e038c824cff service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:10.482662 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-aab4ea6d-c15c-4817-bdc3-e3bcf8903813 req-d24af34b-4b7f-4028-bcbc-8e038c824cff service nova] Creating event network-vif-deleted:6fd6606f-c4cc-4fce-9771-e37ea15a7749 for instance 0c4e6883-b6b6-408f-adb7-2b29610a2150 on hv-cinder-66710 Jun 01 04:35:10.489104 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-aab4ea6d-c15c-4817-bdc3-e3bcf8903813 req-d24af34b-4b7f-4028-bcbc-8e038c824cff service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034487 Jun 01 04:35:10.489851 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 362/710] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:35:10.539054 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-cca4ff15-6445-4941-b8b9-51e7826f56c4 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:10.539885 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-cca4ff15-6445-4941-b8b9-51e7826f56c4 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:10.547105 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cca4ff15-6445-4941-b8b9-51e7826f56c4 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:10.547691 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cca4ff15-6445-4941-b8b9-51e7826f56c4 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:10.548539 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cca4ff15-6445-4941-b8b9-51e7826f56c4 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:10.548985 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cca4ff15-6445-4941-b8b9-51e7826f56c4 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:10.552148 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-7b986d0f-08c9-4bf6-b536-4569550ae842 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:10.560162 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-7b986d0f-08c9-4bf6-b536-4569550ae842 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1277 microversion: 2.1 time: 0.522726 Jun 01 04:35:10.560969 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 349/711] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:10 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1277 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:10.626554 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-cca4ff15-6445-4941-b8b9-51e7826f56c4 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:10.635613 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-cca4ff15-6445-4941-b8b9-51e7826f56c4 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1310 microversion: 2.1 time: 0.100720 Jun 01 04:35:10.638587 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 363/712] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:10 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1310 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:35:10.846365 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-0d91e853-a554-4b1b-8b22-92b016e5d3b5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:10.847226 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-0d91e853-a554-4b1b-8b22-92b016e5d3b5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:10.854525 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0d91e853-a554-4b1b-8b22-92b016e5d3b5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:10.855229 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0d91e853-a554-4b1b-8b22-92b016e5d3b5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:10.856267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0d91e853-a554-4b1b-8b22-92b016e5d3b5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:10.860648 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0d91e853-a554-4b1b-8b22-92b016e5d3b5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:10.935683 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-0d91e853-a554-4b1b-8b22-92b016e5d3b5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12816eca659542af9e41b92fdb674eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda53dca70e54e208b2767a833923234', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:10.943578 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-0d91e853-a554-4b1b-8b22-92b016e5d3b5 tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 200 len: 1306 microversion: 2.1 time: 0.101102 Jun 01 04:35:10.944489 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 350/713] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:10 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 1306 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:11.300716 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-72f6d3f7-fa16-4085-a508-a20a71d3a68e req-65a98658-f576-434b-b517-8dc08da70eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cc59b84-5abc-477a-bcab-4bb682e2cfda", "tag": "37997631-7c0b-45f2-8dde-80c75b82d919"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:35:11.309697 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-72f6d3f7-fa16-4085-a508-a20a71d3a68e req-65a98658-f576-434b-b517-8dc08da70eb7 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:11.310151 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-72f6d3f7-fa16-4085-a508-a20a71d3a68e req-65a98658-f576-434b-b517-8dc08da70eb7 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:11.326634 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-72f6d3f7-fa16-4085-a508-a20a71d3a68e req-65a98658-f576-434b-b517-8dc08da70eb7 service nova] Creating event network-changed:37997631-7c0b-45f2-8dde-80c75b82d919 for instance 4cc59b84-5abc-477a-bcab-4bb682e2cfda on hv-cinder-66710 Jun 01 04:35:11.331845 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-72f6d3f7-fa16-4085-a508-a20a71d3a68e req-65a98658-f576-434b-b517-8dc08da70eb7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035350 Jun 01 04:35:11.332428 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 364/714] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:35:11.578683 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-1abd20a6-a4b3-4ffc-960e-aa7d49073337 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:11.579294 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-1abd20a6-a4b3-4ffc-960e-aa7d49073337 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:11.586803 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1abd20a6-a4b3-4ffc-960e-aa7d49073337 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:11.587422 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1abd20a6-a4b3-4ffc-960e-aa7d49073337 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:11.588249 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1abd20a6-a4b3-4ffc-960e-aa7d49073337 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:11.588683 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1abd20a6-a4b3-4ffc-960e-aa7d49073337 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:11.659960 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b0eda4aa-6d88-4fe0-a1d9-bfbcd868d637 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:11.660768 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-b0eda4aa-6d88-4fe0-a1d9-bfbcd868d637 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:11.671001 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b0eda4aa-6d88-4fe0-a1d9-bfbcd868d637 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:11.671576 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b0eda4aa-6d88-4fe0-a1d9-bfbcd868d637 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:11.672438 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b0eda4aa-6d88-4fe0-a1d9-bfbcd868d637 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:11.672946 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b0eda4aa-6d88-4fe0-a1d9-bfbcd868d637 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:11.754887 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b0eda4aa-6d88-4fe0-a1d9-bfbcd868d637 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:11.773390 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-b0eda4aa-6d88-4fe0-a1d9-bfbcd868d637 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1316 microversion: 2.1 time: 0.119191 Jun 01 04:35:11.775564 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 365/715] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:11 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1316 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:35:11.868162 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-1abd20a6-a4b3-4ffc-960e-aa7d49073337 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:11.878368 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-1abd20a6-a4b3-4ffc-960e-aa7d49073337 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1265 microversion: 2.1 time: 0.303993 Jun 01 04:35:11.881476 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 351/716] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:11 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1265 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:11.961744 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d1e64eeb-1d33-4ec0-98a3-a417f7c2f27e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:11.962606 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-d1e64eeb-1d33-4ec0-98a3-a417f7c2f27e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] [instance: 0c4e6883-b6b6-408f-adb7-2b29610a2150] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:11.971111 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d1e64eeb-1d33-4ec0-98a3-a417f7c2f27e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:11.971867 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d1e64eeb-1d33-4ec0-98a3-a417f7c2f27e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:11.972995 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d1e64eeb-1d33-4ec0-98a3-a417f7c2f27e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:11.973612 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d1e64eeb-1d33-4ec0-98a3-a417f7c2f27e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:11.990962 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.wsgi [None req-d1e64eeb-1d33-4ec0-98a3-a417f7c2f27e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] HTTP exception thrown: Instance 0c4e6883-b6b6-408f-adb7-2b29610a2150 could not be found. Jun 01 04:35:11.992841 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d1e64eeb-1d33-4ec0-98a3-a417f7c2f27e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Request method failure captured: Jun 01 04:35:11.992841 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: request: GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 HTTP/1.1 Jun 01 04:35:11.992841 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept: application/json Jun 01 04:35:11.992841 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept-Encoding: identity Jun 01 04:35:11.992841 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Connection: close Jun 01 04:35:11.992841 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Length: 0 Jun 01 04:35:11.992841 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Type: application/json Jun 01 04:35:11.992841 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Host: 10.222.0.18 Jun 01 04:35:11.992841 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Openstack-System-Scope: None Jun 01 04:35:11.992841 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: User-Agent: python-urllib3/1.26.9 Jun 01 04:35:11.992841 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Auth-Token: gAAAAABiluq6EdglhZgXiS3poHNwL1UUlx7ueC5joJlWhxd9bYUqBcVhkRgghCVJtLC4e0wLqyaT33kVSWKLZMbzDI4PfCEcbl3WeLPmp8XhZ65e-9_afNsqAcBGQuzFEA_cFCtrXjwsuFGgJBYRijSPhwsG4KkGPRwDtmJAygQq6VRDVmLA8kk Jun 01 04:35:11.992841 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Id: None Jun 01 04:35:11.992841 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Name: None Jun 01 04:35:11.992841 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Identity-Status: Confirmed Jun 01 04:35:11.992841 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Is-Admin-Project: True Jun 01 04:35:11.992841 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Id: default Jun 01 04:35:11.992841 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Name: Default Jun 01 04:35:11.992841 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Id: bda53dca70e54e208b2767a833923234 Jun 01 04:35:11.992841 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-788108745 Jun 01 04:35:11.992841 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Role: reader,member Jun 01 04:35:11.992841 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Roles: reader,member Jun 01 04:35:11.999383 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bda53dca70e54e208b2767a833923234"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_bda53dca70e54e208b2767a833923234"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/bda53dca70e54e208b2767a833923234"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/bda53dca70e54e208b2767a833923234"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:35:11.999383 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant: tempest-ServerRescueNegativeTestJSON-788108745 Jun 01 04:35:11.999383 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Id: bda53dca70e54e208b2767a833923234 Jun 01 04:35:11.999383 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-788108745 Jun 01 04:35:11.999383 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User: tempest-ServerRescueNegativeTestJSON-788108745-project Jun 01 04:35:11.999383 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Id: default Jun 01 04:35:11.999383 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Name: Default Jun 01 04:35:11.999383 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Id: 12816eca659542af9e41b92fdb674eab Jun 01 04:35:11.999383 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Name: tempest-ServerRescueNegativeTestJSON-788108745-project Jun 01 04:35:11.999383 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: method: > Jun 01 04:35:11.999383 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: exception: Instance 0c4e6883-b6b6-408f-adb7-2b29610a2150 could not be found. Jun 01 04:35:11.999383 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: action_args: {'id': '0c4e6883-b6b6-408f-adb7-2b29610a2150'} Jun 01 04:35:12.000362 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:35:12.000362 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:35:12.000362 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:35:12.000362 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:35:12.000362 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:35:12.000362 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:35:12.000362 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:35:12.000362 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:35:12.000362 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:35:12.000362 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:35:12.000362 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c4e6883-b6b6-408f-adb7-2b29610a2150 could not be found. Jun 01 04:35:12.000362 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:35:12.000362 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:35:12.000362 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:35:12.000362 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:35:12.000362 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:35:12.000362 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:35:12.000362 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:35:12.000362 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:35:12.000362 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:35:12.001786 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:35:12.001786 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 01 04:35:12.001786 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 01 04:35:12.001786 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:35:12.001786 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:35:12.001786 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:35:12.001786 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:35:12.001786 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c4e6883-b6b6-408f-adb7-2b29610a2150 could not be found. Jun 01 04:35:12.001786 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:35:12.001786 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:35:12.001786 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:35:12.001786 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:35:12.001786 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:35:12.001786 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:35:12.001786 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:35:12.001786 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:35:12.001786 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c4e6883-b6b6-408f-adb7-2b29610a2150 could not be found. Jun 01 04:35:12.001786 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:35:12.003124 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d1e64eeb-1d33-4ec0-98a3-a417f7c2f27e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] Returning 404 to user: Instance 0c4e6883-b6b6-408f-adb7-2b29610a2150 could not be found. {{(pid=118516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:35:12.003124 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-d1e64eeb-1d33-4ec0-98a3-a417f7c2f27e tempest-ServerRescueNegativeTestJSON-788108745 tempest-ServerRescueNegativeTestJSON-788108745-project] 10.222.0.18 "GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150" status: 404 len: 111 microversion: 2.1 time: 0.036787 Jun 01 04:35:12.003124 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 366/717] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:11 2022] GET /compute/v2.1/servers/0c4e6883-b6b6-408f-adb7-2b29610a2150 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:35:12.793641 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-f37877ad-5509-443e-834a-d76c72488c31 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:12.795178 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-f37877ad-5509-443e-834a-d76c72488c31 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:12.809807 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f37877ad-5509-443e-834a-d76c72488c31 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:12.810258 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f37877ad-5509-443e-834a-d76c72488c31 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:12.811076 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f37877ad-5509-443e-834a-d76c72488c31 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:12.811632 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f37877ad-5509-443e-834a-d76c72488c31 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:12.897730 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-ff1c5187-cfc6-47d6-bb4f-47f4e0ba9cc0 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:12.898600 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-ff1c5187-cfc6-47d6-bb4f-47f4e0ba9cc0 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:12.910083 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ff1c5187-cfc6-47d6-bb4f-47f4e0ba9cc0 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:12.910532 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ff1c5187-cfc6-47d6-bb4f-47f4e0ba9cc0 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:12.911332 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ff1c5187-cfc6-47d6-bb4f-47f4e0ba9cc0 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:12.913145 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ff1c5187-cfc6-47d6-bb4f-47f4e0ba9cc0 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:13.021565 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-f37877ad-5509-443e-834a-d76c72488c31 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:13.031919 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-f37877ad-5509-443e-834a-d76c72488c31 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1358 microversion: 2.1 time: 0.241986 Jun 01 04:35:13.033171 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 352/718] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:12 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1358 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:13.342231 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-ff1c5187-cfc6-47d6-bb4f-47f4e0ba9cc0 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:13.352480 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-ff1c5187-cfc6-47d6-bb4f-47f4e0ba9cc0 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1265 microversion: 2.1 time: 0.458281 Jun 01 04:35:13.368475 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 367/719] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:12 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1265 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:14.050458 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-cf5c7456-c1a2-402a-8880-eddbef6c1827 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:14.051080 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-cf5c7456-c1a2-402a-8880-eddbef6c1827 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:14.066594 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-cf5c7456-c1a2-402a-8880-eddbef6c1827 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:14.067273 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-cf5c7456-c1a2-402a-8880-eddbef6c1827 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:14.068530 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-cf5c7456-c1a2-402a-8880-eddbef6c1827 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:14.069157 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-cf5c7456-c1a2-402a-8880-eddbef6c1827 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:14.094216 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:35:14.280343 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-cf5c7456-c1a2-402a-8880-eddbef6c1827 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:14.299866 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-cf5c7456-c1a2-402a-8880-eddbef6c1827 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1358 microversion: 2.1 time: 0.252424 Jun 01 04:35:14.321414 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 353/720] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:14 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1358 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:14.374417 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-4f7389d9-20e7-47bf-b1c7-477b561f8ad5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:14.375361 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-4f7389d9-20e7-47bf-b1c7-477b561f8ad5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:14.386608 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4f7389d9-20e7-47bf-b1c7-477b561f8ad5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:14.390366 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4f7389d9-20e7-47bf-b1c7-477b561f8ad5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:14.391660 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4f7389d9-20e7-47bf-b1c7-477b561f8ad5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:14.392321 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4f7389d9-20e7-47bf-b1c7-477b561f8ad5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:14.468935 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-da60e462-df75-4424-af58-093de47d734d req-e449f682-0ee1-486e-b776-2fcbfcb5a92e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a901966-c203-41d4-9db4-e2a896daffa7", "tag": "fe4b660b-fcd7-4ccb-8056-f5657999e42f"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:35:14.525578 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-da60e462-df75-4424-af58-093de47d734d req-e449f682-0ee1-486e-b776-2fcbfcb5a92e service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:14.526843 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-da60e462-df75-4424-af58-093de47d734d req-e449f682-0ee1-486e-b776-2fcbfcb5a92e service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:14.548633 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-da60e462-df75-4424-af58-093de47d734d req-e449f682-0ee1-486e-b776-2fcbfcb5a92e service nova] Creating event network-changed:fe4b660b-fcd7-4ccb-8056-f5657999e42f for instance 8a901966-c203-41d4-9db4-e2a896daffa7 on hv-cinder-66710 Jun 01 04:35:14.560250 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-da60e462-df75-4424-af58-093de47d734d req-e449f682-0ee1-486e-b776-2fcbfcb5a92e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105087 Jun 01 04:35:14.561112 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 354/721] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:35:14.690723 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-4f7389d9-20e7-47bf-b1c7-477b561f8ad5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:14.705529 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-4f7389d9-20e7-47bf-b1c7-477b561f8ad5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1265 microversion: 2.1 time: 0.335676 Jun 01 04:35:14.709046 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 368/722] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:14 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1265 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:15.338937 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-5765e308-8e56-439a-9c01-bc532bbae9af tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:15.338937 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-5765e308-8e56-439a-9c01-bc532bbae9af tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:15.347018 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5765e308-8e56-439a-9c01-bc532bbae9af tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:15.347819 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5765e308-8e56-439a-9c01-bc532bbae9af tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:15.350539 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5765e308-8e56-439a-9c01-bc532bbae9af tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:15.352014 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5765e308-8e56-439a-9c01-bc532bbae9af tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:15.613290 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-5765e308-8e56-439a-9c01-bc532bbae9af tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:15.621716 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-5765e308-8e56-439a-9c01-bc532bbae9af tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1358 microversion: 2.1 time: 0.296387 Jun 01 04:35:15.622721 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 355/723] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:15 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1358 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:15.727129 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-6d4d40b1-9ba8-4236-9b0b-ed7518c1d6a0 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:15.727767 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-6d4d40b1-9ba8-4236-9b0b-ed7518c1d6a0 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:15.737600 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6d4d40b1-9ba8-4236-9b0b-ed7518c1d6a0 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:15.738054 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6d4d40b1-9ba8-4236-9b0b-ed7518c1d6a0 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:15.742571 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6d4d40b1-9ba8-4236-9b0b-ed7518c1d6a0 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:15.743069 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6d4d40b1-9ba8-4236-9b0b-ed7518c1d6a0 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:16.025802 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-6d4d40b1-9ba8-4236-9b0b-ed7518c1d6a0 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:16.050553 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-6d4d40b1-9ba8-4236-9b0b-ed7518c1d6a0 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1265 microversion: 2.1 time: 0.324980 Jun 01 04:35:16.060489 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 369/724] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:15 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1265 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:16.641880 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a387d3cb-c776-43d8-aff0-0f5febf9a4e1 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:16.643168 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-a387d3cb-c776-43d8-aff0-0f5febf9a4e1 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:16.653674 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a387d3cb-c776-43d8-aff0-0f5febf9a4e1 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:16.654127 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a387d3cb-c776-43d8-aff0-0f5febf9a4e1 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:16.656159 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a387d3cb-c776-43d8-aff0-0f5febf9a4e1 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:16.656810 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a387d3cb-c776-43d8-aff0-0f5febf9a4e1 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:16.874892 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-a387d3cb-c776-43d8-aff0-0f5febf9a4e1 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:16.895922 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-a387d3cb-c776-43d8-aff0-0f5febf9a4e1 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1358 microversion: 2.1 time: 0.250222 Jun 01 04:35:16.895922 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 356/725] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:16 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:17.077881 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-15de206a-4c79-475b-ac08-7d5ef236ed6c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:17.080540 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-15de206a-4c79-475b-ac08-7d5ef236ed6c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:17.089335 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-15de206a-4c79-475b-ac08-7d5ef236ed6c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:17.092299 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-15de206a-4c79-475b-ac08-7d5ef236ed6c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:17.093982 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-15de206a-4c79-475b-ac08-7d5ef236ed6c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:17.094936 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-15de206a-4c79-475b-ac08-7d5ef236ed6c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:17.504779 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-15de206a-4c79-475b-ac08-7d5ef236ed6c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:17.516131 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-15de206a-4c79-475b-ac08-7d5ef236ed6c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1265 microversion: 2.1 time: 0.446107 Jun 01 04:35:17.516948 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 370/726] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:17 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1265 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:17.905200 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-9c000750-5b47-43fb-a700-081a52d924e6 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:17.906421 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-9c000750-5b47-43fb-a700-081a52d924e6 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:17.918758 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9c000750-5b47-43fb-a700-081a52d924e6 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:17.919219 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9c000750-5b47-43fb-a700-081a52d924e6 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:17.920057 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9c000750-5b47-43fb-a700-081a52d924e6 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:17.920495 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9c000750-5b47-43fb-a700-081a52d924e6 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:18.197895 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell0:SELECT=4 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:35:18.243791 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-9c000750-5b47-43fb-a700-081a52d924e6 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:18.254175 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-9c000750-5b47-43fb-a700-081a52d924e6 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1358 microversion: 2.1 time: 0.353206 Jun 01 04:35:18.255352 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 357/727] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:17 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1358 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:18.534316 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-56b7689d-5da4-49da-8193-574fa819957c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:18.539205 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-56b7689d-5da4-49da-8193-574fa819957c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:18.539205 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell0:SELECT=8 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:35:18.542799 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-56b7689d-5da4-49da-8193-574fa819957c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:18.543407 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-56b7689d-5da4-49da-8193-574fa819957c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:18.544546 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-56b7689d-5da4-49da-8193-574fa819957c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:18.545253 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-56b7689d-5da4-49da-8193-574fa819957c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:18.703577 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-56b7689d-5da4-49da-8193-574fa819957c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:18.711633 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-56b7689d-5da4-49da-8193-574fa819957c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1265 microversion: 2.1 time: 0.182147 Jun 01 04:35:18.715715 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 371/728] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:18 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:35:19.277273 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-4292137e-e661-432f-880e-bce373add375 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:19.278057 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-4292137e-e661-432f-880e-bce373add375 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:19.285968 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4292137e-e661-432f-880e-bce373add375 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:19.286502 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4292137e-e661-432f-880e-bce373add375 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:19.287395 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4292137e-e661-432f-880e-bce373add375 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:19.288872 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4292137e-e661-432f-880e-bce373add375 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:19.449648 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-4292137e-e661-432f-880e-bce373add375 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:19.462146 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-4292137e-e661-432f-880e-bce373add375 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1358 microversion: 2.1 time: 0.189000 Jun 01 04:35:19.462861 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 358/729] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:19 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:19.728576 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d7f4c1f6-b88b-48fe-8489-213252fa935a tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:19.729244 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-d7f4c1f6-b88b-48fe-8489-213252fa935a tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:19.736969 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d7f4c1f6-b88b-48fe-8489-213252fa935a tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:19.738557 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d7f4c1f6-b88b-48fe-8489-213252fa935a tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:19.738557 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d7f4c1f6-b88b-48fe-8489-213252fa935a tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:19.738824 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d7f4c1f6-b88b-48fe-8489-213252fa935a tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:19.898526 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-d7f4c1f6-b88b-48fe-8489-213252fa935a tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:19.908719 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-d7f4c1f6-b88b-48fe-8489-213252fa935a tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1265 microversion: 2.1 time: 0.183909 Jun 01 04:35:19.909522 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 372/730] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:19 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:20.479514 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-d390ef8e-31a3-4f0d-9395-6a8ab5915341 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:20.480158 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-d390ef8e-31a3-4f0d-9395-6a8ab5915341 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:20.481993 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell0:SELECT=16 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:35:20.489327 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d390ef8e-31a3-4f0d-9395-6a8ab5915341 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:20.489327 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d390ef8e-31a3-4f0d-9395-6a8ab5915341 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:20.489327 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d390ef8e-31a3-4f0d-9395-6a8ab5915341 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:20.489327 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d390ef8e-31a3-4f0d-9395-6a8ab5915341 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:20.628707 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-d390ef8e-31a3-4f0d-9395-6a8ab5915341 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:20.636647 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-d390ef8e-31a3-4f0d-9395-6a8ab5915341 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1358 microversion: 2.1 time: 0.160939 Jun 01 04:35:20.637217 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 359/731] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:20 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:20.926370 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-2123964f-1122-4cbd-a052-57e4b488ebf5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:20.926975 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-2123964f-1122-4cbd-a052-57e4b488ebf5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:20.933466 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2123964f-1122-4cbd-a052-57e4b488ebf5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:20.933918 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2123964f-1122-4cbd-a052-57e4b488ebf5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:20.934683 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2123964f-1122-4cbd-a052-57e4b488ebf5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:20.935125 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2123964f-1122-4cbd-a052-57e4b488ebf5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:21.075102 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-2123964f-1122-4cbd-a052-57e4b488ebf5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:21.083585 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-2123964f-1122-4cbd-a052-57e4b488ebf5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1265 microversion: 2.1 time: 0.160952 Jun 01 04:35:21.089909 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 373/732] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:20 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:21.654755 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b7508173-77f7-432c-a63b-9cf1efd81efa tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:21.654755 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-b7508173-77f7-432c-a63b-9cf1efd81efa tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:21.661449 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b7508173-77f7-432c-a63b-9cf1efd81efa tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:21.661839 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b7508173-77f7-432c-a63b-9cf1efd81efa tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:21.662614 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b7508173-77f7-432c-a63b-9cf1efd81efa tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:21.663050 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b7508173-77f7-432c-a63b-9cf1efd81efa tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:21.766861 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-93dfa1c3-ad6a-4ee2-9a5b-04f33e7d74b2 tempest-VolumesGetTestJSON-1652374642 tempest-VolumesGetTestJSON-1652374642-project] Action: 'create', calling method: .version_select at 0x7ff325874310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-361833315", "metadata": {"Type": "work"}}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:35:21.794016 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b7508173-77f7-432c-a63b-9cf1efd81efa tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:21.802036 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-b7508173-77f7-432c-a63b-9cf1efd81efa tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1358 microversion: 2.1 time: 0.151875 Jun 01 04:35:21.802680 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 374/733] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:21 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:35:22.101613 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-dec08309-a8ae-4ac4-a456-a800ad0e119c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:22.102236 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-dec08309-a8ae-4ac4-a456-a800ad0e119c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:22.108784 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-dec08309-a8ae-4ac4-a456-a800ad0e119c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:22.109234 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-dec08309-a8ae-4ac4-a456-a800ad0e119c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:22.110261 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-dec08309-a8ae-4ac4-a456-a800ad0e119c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:22.110709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-dec08309-a8ae-4ac4-a456-a800ad0e119c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:22.245796 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-dec08309-a8ae-4ac4-a456-a800ad0e119c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:22.254150 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-dec08309-a8ae-4ac4-a456-a800ad0e119c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1265 microversion: 2.1 time: 0.156529 Jun 01 04:35:22.254733 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 375/734] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:22 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:35:22.414586 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-93dfa1c3-ad6a-4ee2-9a5b-04f33e7d74b2 tempest-VolumesGetTestJSON-1652374642 tempest-VolumesGetTestJSON-1652374642-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.767179 Jun 01 04:35:22.415235 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 360/735] 10.222.0.18 () {60 vars in 1155 bytes} [Wed Jun 1 04:35:21 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 768 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 01 04:35:22.426002 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-0a2910a5-e6a6-4894-a86d-2af5ae797bc3 tempest-VolumesGetTestJSON-1652374642 tempest-VolumesGetTestJSON-1652374642-project] Calling method '.version_select at 0x7ff325965940>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:22.473591 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-0a2910a5-e6a6-4894-a86d-2af5ae797bc3 tempest-VolumesGetTestJSON-1652374642 tempest-VolumesGetTestJSON-1652374642-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/2b59509b-e478-4059-9d94-7b19e2865b53" status: 200 len: 352 microversion: 2.1 time: 0.051284 Jun 01 04:35:22.478407 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 376/736] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 1 04:35:22 2022] GET /compute/v2.1/os-volumes/2b59509b-e478-4059-9d94-7b19e2865b53 => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:35:22.820067 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-332fd267-fb39-4be9-afb1-cee632edcad4 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:22.820662 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-332fd267-fb39-4be9-afb1-cee632edcad4 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:22.827422 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-332fd267-fb39-4be9-afb1-cee632edcad4 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:22.827875 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-332fd267-fb39-4be9-afb1-cee632edcad4 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:22.828628 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-332fd267-fb39-4be9-afb1-cee632edcad4 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:22.829054 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-332fd267-fb39-4be9-afb1-cee632edcad4 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:22.961897 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-332fd267-fb39-4be9-afb1-cee632edcad4 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:22.970077 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-332fd267-fb39-4be9-afb1-cee632edcad4 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1358 microversion: 2.1 time: 0.154358 Jun 01 04:35:22.970636 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 361/737] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:22 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:23.271407 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d4772842-9b14-40f5-8215-b02ac0f8d6c5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:23.271946 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-d4772842-9b14-40f5-8215-b02ac0f8d6c5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:23.278016 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d4772842-9b14-40f5-8215-b02ac0f8d6c5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:23.278463 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d4772842-9b14-40f5-8215-b02ac0f8d6c5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:23.279220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d4772842-9b14-40f5-8215-b02ac0f8d6c5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:23.279687 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d4772842-9b14-40f5-8215-b02ac0f8d6c5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:23.416882 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-d4772842-9b14-40f5-8215-b02ac0f8d6c5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:23.424572 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-d4772842-9b14-40f5-8215-b02ac0f8d6c5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1265 microversion: 2.1 time: 0.157549 Jun 01 04:35:23.425137 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 377/738] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:23 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:23.486048 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-6dd58fa2-04d7-43cb-9d76-5e83590e13aa tempest-VolumesGetTestJSON-1652374642 tempest-VolumesGetTestJSON-1652374642-project] Calling method '.version_select at 0x7ff325874310>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:23.532938 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-6dd58fa2-04d7-43cb-9d76-5e83590e13aa tempest-VolumesGetTestJSON-1652374642 tempest-VolumesGetTestJSON-1652374642-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/2b59509b-e478-4059-9d94-7b19e2865b53" status: 200 len: 352 microversion: 2.1 time: 0.050894 Jun 01 04:35:23.533518 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 362/739] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 1 04:35:23 2022] GET /compute/v2.1/os-volumes/2b59509b-e478-4059-9d94-7b19e2865b53 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:35:23.987259 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-ca41b95b-bfe0-466e-91df-5a7185137641 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:23.987854 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-ca41b95b-bfe0-466e-91df-5a7185137641 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:23.993838 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ca41b95b-bfe0-466e-91df-5a7185137641 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:23.994287 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ca41b95b-bfe0-466e-91df-5a7185137641 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:23.995048 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ca41b95b-bfe0-466e-91df-5a7185137641 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:23.995524 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ca41b95b-bfe0-466e-91df-5a7185137641 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:24.122301 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-ca41b95b-bfe0-466e-91df-5a7185137641 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:24.130633 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-ca41b95b-bfe0-466e-91df-5a7185137641 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1358 microversion: 2.1 time: 0.147580 Jun 01 04:35:24.131192 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 378/740] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:23 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:24.442454 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-3adacf95-488f-4530-8f05-11eef175996c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:24.443128 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-3adacf95-488f-4530-8f05-11eef175996c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:24.449785 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3adacf95-488f-4530-8f05-11eef175996c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:24.450191 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3adacf95-488f-4530-8f05-11eef175996c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:24.450968 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3adacf95-488f-4530-8f05-11eef175996c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:24.451523 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3adacf95-488f-4530-8f05-11eef175996c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:24.546663 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-081aaa41-b4bf-4209-9c8a-e367afdcbfd1 tempest-VolumesGetTestJSON-1652374642 tempest-VolumesGetTestJSON-1652374642-project] Calling method '.version_select at 0x7ff325a1cca0>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:24.592363 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-3adacf95-488f-4530-8f05-11eef175996c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:24.602560 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-3adacf95-488f-4530-8f05-11eef175996c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1265 microversion: 2.1 time: 0.164310 Jun 01 04:35:24.603702 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 363/741] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:24 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:24.617520 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-081aaa41-b4bf-4209-9c8a-e367afdcbfd1 tempest-VolumesGetTestJSON-1652374642 tempest-VolumesGetTestJSON-1652374642-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/2b59509b-e478-4059-9d94-7b19e2865b53" status: 200 len: 353 microversion: 2.1 time: 0.075461 Jun 01 04:35:24.629363 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 379/742] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 1 04:35:24 2022] GET /compute/v2.1/os-volumes/2b59509b-e478-4059-9d94-7b19e2865b53 => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:35:24.634019 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-1db5db92-6df5-4c7a-8c0c-7c7333301e83 tempest-VolumesGetTestJSON-1652374642 tempest-VolumesGetTestJSON-1652374642-project] Calling method '.version_select at 0x7ff325809820>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:24.689288 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-1db5db92-6df5-4c7a-8c0c-7c7333301e83 tempest-VolumesGetTestJSON-1652374642 tempest-VolumesGetTestJSON-1652374642-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/2b59509b-e478-4059-9d94-7b19e2865b53" status: 200 len: 353 microversion: 2.1 time: 0.062845 Jun 01 04:35:24.689862 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 364/743] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 1 04:35:24 2022] GET /compute/v2.1/os-volumes/2b59509b-e478-4059-9d94-7b19e2865b53 => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:35:24.705481 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b30762d1-ebc9-4b72-8a23-122a5e8ec888 tempest-VolumesGetTestJSON-1652374642 tempest-VolumesGetTestJSON-1652374642-project] Calling method '.version_select at 0x7ff32587ca60>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:24.914280 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-b30762d1-ebc9-4b72-8a23-122a5e8ec888 tempest-VolumesGetTestJSON-1652374642 tempest-VolumesGetTestJSON-1652374642-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/2b59509b-e478-4059-9d94-7b19e2865b53" status: 202 len: 0 microversion: 2.1 time: 0.212578 Jun 01 04:35:24.914929 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 380/744] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jun 1 04:35:24 2022] DELETE /compute/v2.1/os-volumes/2b59509b-e478-4059-9d94-7b19e2865b53 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 01 04:35:24.923739 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-f3f59a5f-0e0e-4aa9-b79f-dab0c5ab85dc tempest-VolumesGetTestJSON-1652374642 tempest-VolumesGetTestJSON-1652374642-project] Calling method '.version_select at 0x7ff325a02700>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:24.975033 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-f3f59a5f-0e0e-4aa9-b79f-dab0c5ab85dc tempest-VolumesGetTestJSON-1652374642 tempest-VolumesGetTestJSON-1652374642-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/2b59509b-e478-4059-9d94-7b19e2865b53" status: 200 len: 352 microversion: 2.1 time: 0.055811 Jun 01 04:35:24.975682 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 365/745] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 1 04:35:24 2022] GET /compute/v2.1/os-volumes/2b59509b-e478-4059-9d94-7b19e2865b53 => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:35:25.148716 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-e54536b9-2a1c-4db2-9c99-72e17b249cab tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:25.149288 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-e54536b9-2a1c-4db2-9c99-72e17b249cab tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:25.156624 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e54536b9-2a1c-4db2-9c99-72e17b249cab tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:25.157131 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e54536b9-2a1c-4db2-9c99-72e17b249cab tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:25.157859 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e54536b9-2a1c-4db2-9c99-72e17b249cab tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:25.158305 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e54536b9-2a1c-4db2-9c99-72e17b249cab tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:25.162591 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:35:25.297945 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-e54536b9-2a1c-4db2-9c99-72e17b249cab tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:25.305587 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-e54536b9-2a1c-4db2-9c99-72e17b249cab tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1358 microversion: 2.1 time: 0.161224 Jun 01 04:35:25.306234 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 381/746] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:25 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:25.629754 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-7387f75c-1d50-4122-bcad-37969f672068 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:25.630336 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-7387f75c-1d50-4122-bcad-37969f672068 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:25.637223 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7387f75c-1d50-4122-bcad-37969f672068 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:25.637671 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7387f75c-1d50-4122-bcad-37969f672068 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:25.638437 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7387f75c-1d50-4122-bcad-37969f672068 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:25.638872 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7387f75c-1d50-4122-bcad-37969f672068 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:25.779688 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-7387f75c-1d50-4122-bcad-37969f672068 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:25.788020 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-7387f75c-1d50-4122-bcad-37969f672068 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1265 microversion: 2.1 time: 0.165215 Jun 01 04:35:25.788595 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 366/747] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:25 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:25.991661 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-6af09121-cace-4bd5-b54d-5f3009429491 tempest-VolumesGetTestJSON-1652374642 tempest-VolumesGetTestJSON-1652374642-project] Calling method '.version_select at 0x7ff325a1c5e0>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:26.027910 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.wsgi [None req-6af09121-cace-4bd5-b54d-5f3009429491 tempest-VolumesGetTestJSON-1652374642 tempest-VolumesGetTestJSON-1652374642-project] HTTP exception thrown: Volume 2b59509b-e478-4059-9d94-7b19e2865b53 could not be found. Jun 01 04:35:26.029871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-6af09121-cace-4bd5-b54d-5f3009429491 tempest-VolumesGetTestJSON-1652374642 tempest-VolumesGetTestJSON-1652374642-project] Request method failure captured: Jun 01 04:35:26.029871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: request: GET /compute/v2.1/os-volumes/2b59509b-e478-4059-9d94-7b19e2865b53 HTTP/1.1 Jun 01 04:35:26.029871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept: application/json Jun 01 04:35:26.029871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept-Encoding: identity Jun 01 04:35:26.029871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Connection: close Jun 01 04:35:26.029871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Length: 0 Jun 01 04:35:26.029871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Type: application/json Jun 01 04:35:26.029871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Host: 10.222.0.18 Jun 01 04:35:26.029871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Openstack-System-Scope: None Jun 01 04:35:26.029871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: User-Agent: python-urllib3/1.26.9 Jun 01 04:35:26.029871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Auth-Token: gAAAAABiluyJ6jubUGVe73rRjssMw0NBI25poucBUi8VhcOBJ3OWPNICqSOddIvlQ7tt2Ylm8vpsm2VO5Un5XR1l25PT_aCOvlIunjnhC7d3J6HOAvlba9B8qeqxh_jSOau60H1SQkAi98k7gDVw5dxdJoL13XUFTxzmL8DBs_doOZtN3iQQKRE Jun 01 04:35:26.029871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Id: None Jun 01 04:35:26.029871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Name: None Jun 01 04:35:26.029871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Identity-Status: Confirmed Jun 01 04:35:26.029871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Is-Admin-Project: True Jun 01 04:35:26.029871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Id: default Jun 01 04:35:26.029871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Name: Default Jun 01 04:35:26.029871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Id: 8333093d796544d3962a75a59404a613 Jun 01 04:35:26.029871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Name: tempest-VolumesGetTestJSON-1652374642 Jun 01 04:35:26.029871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Role: reader,member Jun 01 04:35:26.029871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Roles: reader,member Jun 01 04:35:26.032500 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8333093d796544d3962a75a59404a613"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8333093d796544d3962a75a59404a613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8333093d796544d3962a75a59404a613"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8333093d796544d3962a75a59404a613"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:35:26.032500 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant: tempest-VolumesGetTestJSON-1652374642 Jun 01 04:35:26.032500 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Id: 8333093d796544d3962a75a59404a613 Jun 01 04:35:26.032500 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Name: tempest-VolumesGetTestJSON-1652374642 Jun 01 04:35:26.032500 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User: tempest-VolumesGetTestJSON-1652374642-project Jun 01 04:35:26.032500 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Id: default Jun 01 04:35:26.032500 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Name: Default Jun 01 04:35:26.032500 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Id: db7952d498e64c9db76878af469ccaf6 Jun 01 04:35:26.032500 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Name: tempest-VolumesGetTestJSON-1652374642-project Jun 01 04:35:26.032500 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: method: Jun 01 04:35:26.032500 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: exception: Volume 2b59509b-e478-4059-9d94-7b19e2865b53 could not be found. Jun 01 04:35:26.032500 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: action_args: {'id': '2b59509b-e478-4059-9d94-7b19e2865b53'} Jun 01 04:35:26.032500 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:35:26.033672 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:35:26.033672 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 01 04:35:26.033672 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 01 04:35:26.033672 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 01 04:35:26.033672 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 01 04:35:26.033672 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 01 04:35:26.033672 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 01 04:35:26.033672 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 01 04:35:26.033672 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 01 04:35:26.033672 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 01 04:35:26.033672 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 01 04:35:26.033672 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 01 04:35:26.033672 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 01 04:35:26.033672 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 01 04:35:26.033672 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 01 04:35:26.033672 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2b59509b-e478-4059-9d94-7b19e2865b53 could not be found. (HTTP 404) (Request-ID: req-91e8570b-e6ed-44a7-8f78-5b7b9637d7f9) Jun 01 04:35:26.033672 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:35:26.033672 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:35:26.033672 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:35:26.035385 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:35:26.035385 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 01 04:35:26.035385 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 01 04:35:26.035385 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 01 04:35:26.035385 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 01 04:35:26.035385 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 01 04:35:26.035385 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 01 04:35:26.035385 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 01 04:35:26.035385 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 01 04:35:26.035385 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 01 04:35:26.035385 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 01 04:35:26.035385 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 01 04:35:26.035385 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 01 04:35:26.035385 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 01 04:35:26.035385 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 01 04:35:26.035385 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 01 04:35:26.035385 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 01 04:35:26.035385 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 01 04:35:26.035385 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 01 04:35:26.039657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 01 04:35:26.039657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 01 04:35:26.039657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 01 04:35:26.039657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 01 04:35:26.039657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2b59509b-e478-4059-9d94-7b19e2865b53 could not be found. Jun 01 04:35:26.039657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:35:26.039657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:35:26.039657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:35:26.039657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:35:26.039657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:35:26.039657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:35:26.039657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:35:26.039657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:35:26.039657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 01 04:35:26.039657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 01 04:35:26.039657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:35:26.039657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:35:26.039657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 01 04:35:26.039657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:35:26.041565 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2b59509b-e478-4059-9d94-7b19e2865b53 could not be found. Jun 01 04:35:26.041565 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:35:26.041565 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:35:26.041565 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:35:26.041565 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:35:26.041565 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:35:26.041565 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:35:26.041565 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:35:26.041565 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:35:26.041565 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2b59509b-e478-4059-9d94-7b19e2865b53 could not be found. Jun 01 04:35:26.041565 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:35:26.041565 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-6af09121-cace-4bd5-b54d-5f3009429491 tempest-VolumesGetTestJSON-1652374642 tempest-VolumesGetTestJSON-1652374642-project] Returning 404 to user: Volume 2b59509b-e478-4059-9d94-7b19e2865b53 could not be found. {{(pid=118516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:35:26.041565 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-6af09121-cace-4bd5-b54d-5f3009429491 tempest-VolumesGetTestJSON-1652374642 tempest-VolumesGetTestJSON-1652374642-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/2b59509b-e478-4059-9d94-7b19e2865b53" status: 404 len: 109 microversion: 2.1 time: 0.048220 Jun 01 04:35:26.041565 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 382/748] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jun 1 04:35:25 2022] GET /compute/v2.1/os-volumes/2b59509b-e478-4059-9d94-7b19e2865b53 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 01 04:35:26.321860 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-c4b9bf3d-f3b1-46fa-b704-a84d6dc219aa tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:26.322460 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-c4b9bf3d-f3b1-46fa-b704-a84d6dc219aa tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:26.328650 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c4b9bf3d-f3b1-46fa-b704-a84d6dc219aa tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:26.329098 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c4b9bf3d-f3b1-46fa-b704-a84d6dc219aa tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:26.329847 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c4b9bf3d-f3b1-46fa-b704-a84d6dc219aa tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:26.330275 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c4b9bf3d-f3b1-46fa-b704-a84d6dc219aa tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:26.459627 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-c4b9bf3d-f3b1-46fa-b704-a84d6dc219aa tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:26.467159 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-c4b9bf3d-f3b1-46fa-b704-a84d6dc219aa tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1358 microversion: 2.1 time: 0.149042 Jun 01 04:35:26.468413 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 367/749] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:26 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:26.805930 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-143c7968-691c-4140-a59c-496ad71e1c37 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:26.806584 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-143c7968-691c-4140-a59c-496ad71e1c37 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:26.814469 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-143c7968-691c-4140-a59c-496ad71e1c37 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:26.814946 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-143c7968-691c-4140-a59c-496ad71e1c37 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:26.815780 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-143c7968-691c-4140-a59c-496ad71e1c37 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:26.816218 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-143c7968-691c-4140-a59c-496ad71e1c37 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:26.951459 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-143c7968-691c-4140-a59c-496ad71e1c37 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:26.960472 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-143c7968-691c-4140-a59c-496ad71e1c37 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1265 microversion: 2.1 time: 0.158407 Jun 01 04:35:26.961456 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 383/750] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:26 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:27.485398 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-0c80167a-815c-4e14-9378-cec79987dc58 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:27.486627 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-0c80167a-815c-4e14-9378-cec79987dc58 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:27.493760 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0c80167a-815c-4e14-9378-cec79987dc58 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:27.494212 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0c80167a-815c-4e14-9378-cec79987dc58 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:27.495040 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0c80167a-815c-4e14-9378-cec79987dc58 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:27.495511 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0c80167a-815c-4e14-9378-cec79987dc58 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:27.635994 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-0c80167a-815c-4e14-9378-cec79987dc58 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:27.644203 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-0c80167a-815c-4e14-9378-cec79987dc58 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1358 microversion: 2.1 time: 0.163319 Jun 01 04:35:27.644764 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 368/751] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:27 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:27.979013 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-71535183-1973-42b9-9c31-8c63b1496b78 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:27.980133 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-71535183-1973-42b9-9c31-8c63b1496b78 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:27.987343 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-71535183-1973-42b9-9c31-8c63b1496b78 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:27.988033 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-71535183-1973-42b9-9c31-8c63b1496b78 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:27.989609 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-71535183-1973-42b9-9c31-8c63b1496b78 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:27.990207 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-71535183-1973-42b9-9c31-8c63b1496b78 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:28.138566 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-71535183-1973-42b9-9c31-8c63b1496b78 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:28.146649 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-71535183-1973-42b9-9c31-8c63b1496b78 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1265 microversion: 2.1 time: 0.172603 Jun 01 04:35:28.147211 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 384/752] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:27 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:28.661090 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-d1bc70a6-00ea-4b78-b09e-320d1659c1fd tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:28.661710 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-d1bc70a6-00ea-4b78-b09e-320d1659c1fd tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:28.668119 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d1bc70a6-00ea-4b78-b09e-320d1659c1fd tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:28.668572 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d1bc70a6-00ea-4b78-b09e-320d1659c1fd tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:28.669374 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d1bc70a6-00ea-4b78-b09e-320d1659c1fd tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:28.669813 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d1bc70a6-00ea-4b78-b09e-320d1659c1fd tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:28.802028 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-d1bc70a6-00ea-4b78-b09e-320d1659c1fd tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:28.809523 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-d1bc70a6-00ea-4b78-b09e-320d1659c1fd tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1358 microversion: 2.1 time: 0.152300 Jun 01 04:35:28.810099 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 369/753] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:28 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:29.165478 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-49d6f677-2cb1-4763-bbc6-5fdd06d00324 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:29.166910 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-49d6f677-2cb1-4763-bbc6-5fdd06d00324 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:29.174289 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-49d6f677-2cb1-4763-bbc6-5fdd06d00324 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:29.175172 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-49d6f677-2cb1-4763-bbc6-5fdd06d00324 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:29.176017 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-49d6f677-2cb1-4763-bbc6-5fdd06d00324 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:29.177032 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-49d6f677-2cb1-4763-bbc6-5fdd06d00324 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:29.316399 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-49d6f677-2cb1-4763-bbc6-5fdd06d00324 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:29.324001 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-49d6f677-2cb1-4763-bbc6-5fdd06d00324 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1265 microversion: 2.1 time: 0.163701 Jun 01 04:35:29.324557 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 385/754] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:29 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:29.449328 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-cd8814ba-4e03-4aba-860d-c7d83972b794 req-41073f5a-a264-4f3a-932c-65aa53b26f2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a901966-c203-41d4-9db4-e2a896daffa7", "name": "network-vif-plugged", "status": "completed", "tag": "fe4b660b-fcd7-4ccb-8056-f5657999e42f"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:35:29.457349 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-cd8814ba-4e03-4aba-860d-c7d83972b794 req-41073f5a-a264-4f3a-932c-65aa53b26f2a service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:29.457788 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-cd8814ba-4e03-4aba-860d-c7d83972b794 req-41073f5a-a264-4f3a-932c-65aa53b26f2a service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:29.469312 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-cd8814ba-4e03-4aba-860d-c7d83972b794 req-41073f5a-a264-4f3a-932c-65aa53b26f2a service nova] Creating event network-vif-plugged:fe4b660b-fcd7-4ccb-8056-f5657999e42f for instance 8a901966-c203-41d4-9db4-e2a896daffa7 on hv-cinder-66710 Jun 01 04:35:29.475132 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-cd8814ba-4e03-4aba-860d-c7d83972b794 req-41073f5a-a264-4f3a-932c-65aa53b26f2a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029526 Jun 01 04:35:29.480108 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 370/755] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:35:29.827900 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-cd879d32-1700-4250-9514-6cf8f975434a tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:29.828513 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-cd879d32-1700-4250-9514-6cf8f975434a tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:29.834656 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cd879d32-1700-4250-9514-6cf8f975434a tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:29.835109 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cd879d32-1700-4250-9514-6cf8f975434a tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:29.835903 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cd879d32-1700-4250-9514-6cf8f975434a tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:29.836347 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cd879d32-1700-4250-9514-6cf8f975434a tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:29.961942 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-cd879d32-1700-4250-9514-6cf8f975434a tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:29.969466 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-cd879d32-1700-4250-9514-6cf8f975434a tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1358 microversion: 2.1 time: 0.146080 Jun 01 04:35:29.970026 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 386/756] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:29 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:30.341765 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-202e2db6-ea12-4fa9-90f2-a404838affda tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:30.342573 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-202e2db6-ea12-4fa9-90f2-a404838affda tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:30.348761 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-202e2db6-ea12-4fa9-90f2-a404838affda tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:30.349224 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-202e2db6-ea12-4fa9-90f2-a404838affda tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:30.349984 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-202e2db6-ea12-4fa9-90f2-a404838affda tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:30.350424 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-202e2db6-ea12-4fa9-90f2-a404838affda tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:30.485600 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-202e2db6-ea12-4fa9-90f2-a404838affda tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:30.492968 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-202e2db6-ea12-4fa9-90f2-a404838affda tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1265 microversion: 2.1 time: 0.155827 Jun 01 04:35:30.493539 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 371/757] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:30 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:30.986308 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-185363cf-6b8a-4027-97f2-a5c068b3830b tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:30.986925 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-185363cf-6b8a-4027-97f2-a5c068b3830b tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:30.993843 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-185363cf-6b8a-4027-97f2-a5c068b3830b tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:30.994303 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-185363cf-6b8a-4027-97f2-a5c068b3830b tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:30.995080 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-185363cf-6b8a-4027-97f2-a5c068b3830b tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:30.995555 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-185363cf-6b8a-4027-97f2-a5c068b3830b tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:31.129221 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-185363cf-6b8a-4027-97f2-a5c068b3830b tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:31.136710 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-185363cf-6b8a-4027-97f2-a5c068b3830b tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1358 microversion: 2.1 time: 0.154534 Jun 01 04:35:31.138944 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 387/758] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:30 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:31.509996 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-0dfd049e-afe1-40cb-8b52-e0e0118e2b7c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:31.510773 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-0dfd049e-afe1-40cb-8b52-e0e0118e2b7c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:31.517780 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0dfd049e-afe1-40cb-8b52-e0e0118e2b7c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:31.518239 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0dfd049e-afe1-40cb-8b52-e0e0118e2b7c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:31.519006 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0dfd049e-afe1-40cb-8b52-e0e0118e2b7c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:31.519472 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0dfd049e-afe1-40cb-8b52-e0e0118e2b7c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:31.651985 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-0dfd049e-afe1-40cb-8b52-e0e0118e2b7c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:31.659260 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-0dfd049e-afe1-40cb-8b52-e0e0118e2b7c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1265 microversion: 2.1 time: 0.153231 Jun 01 04:35:31.659838 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 372/759] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:31 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:32.153781 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-497d12df-2f93-423c-9a57-53e9d7fa01ed tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:32.154620 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-497d12df-2f93-423c-9a57-53e9d7fa01ed tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:32.161240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-497d12df-2f93-423c-9a57-53e9d7fa01ed tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:32.161691 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-497d12df-2f93-423c-9a57-53e9d7fa01ed tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:32.162458 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-497d12df-2f93-423c-9a57-53e9d7fa01ed tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:32.162900 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-497d12df-2f93-423c-9a57-53e9d7fa01ed tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:32.298307 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-497d12df-2f93-423c-9a57-53e9d7fa01ed tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:32.305775 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-497d12df-2f93-423c-9a57-53e9d7fa01ed tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1358 microversion: 2.1 time: 0.155915 Jun 01 04:35:32.306332 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 388/760] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:32 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:32.676809 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-1689fe3a-b39c-4ca9-8197-312527386301 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:32.677412 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-1689fe3a-b39c-4ca9-8197-312527386301 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:32.684026 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1689fe3a-b39c-4ca9-8197-312527386301 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:32.684469 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1689fe3a-b39c-4ca9-8197-312527386301 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:32.685225 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1689fe3a-b39c-4ca9-8197-312527386301 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:32.685658 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1689fe3a-b39c-4ca9-8197-312527386301 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:32.822268 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-1689fe3a-b39c-4ca9-8197-312527386301 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:32.830316 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-1689fe3a-b39c-4ca9-8197-312527386301 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1265 microversion: 2.1 time: 0.157346 Jun 01 04:35:32.839282 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 373/761] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:32 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:33.322759 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-425c6eee-7f8a-4fd7-ae45-ef3a1012525c tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:33.323418 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-425c6eee-7f8a-4fd7-ae45-ef3a1012525c tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:33.325748 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:35:33.331027 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-425c6eee-7f8a-4fd7-ae45-ef3a1012525c tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:33.331621 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-425c6eee-7f8a-4fd7-ae45-ef3a1012525c tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:33.332299 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-425c6eee-7f8a-4fd7-ae45-ef3a1012525c tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:33.332773 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-425c6eee-7f8a-4fd7-ae45-ef3a1012525c tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:33.469127 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-425c6eee-7f8a-4fd7-ae45-ef3a1012525c tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:33.484083 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-425c6eee-7f8a-4fd7-ae45-ef3a1012525c tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1547 microversion: 2.1 time: 0.161053 Jun 01 04:35:33.484083 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 389/762] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:33 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1547 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:33.486346 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-80613c48-55c3-49b4-ba8e-6702e4bc292c req-ed823bf6-9261-4339-92d8-c7db2ff07e6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc59b84-5abc-477a-bcab-4bb682e2cfda", "name": "network-vif-plugged", "status": "completed", "tag": "37997631-7c0b-45f2-8dde-80c75b82d919"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:35:33.500866 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-80613c48-55c3-49b4-ba8e-6702e4bc292c req-ed823bf6-9261-4339-92d8-c7db2ff07e6c service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:33.502051 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-80613c48-55c3-49b4-ba8e-6702e4bc292c req-ed823bf6-9261-4339-92d8-c7db2ff07e6c service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:33.509068 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-c25003f4-4580-401a-a2ae-1e7d55342124 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:33.510085 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-c25003f4-4580-401a-a2ae-1e7d55342124 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:33.520830 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c25003f4-4580-401a-a2ae-1e7d55342124 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:33.521121 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-80613c48-55c3-49b4-ba8e-6702e4bc292c req-ed823bf6-9261-4339-92d8-c7db2ff07e6c service nova] Creating event network-vif-plugged:37997631-7c0b-45f2-8dde-80c75b82d919 for instance 4cc59b84-5abc-477a-bcab-4bb682e2cfda on hv-cinder-66710 Jun 01 04:35:33.521560 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c25003f4-4580-401a-a2ae-1e7d55342124 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:33.522828 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c25003f4-4580-401a-a2ae-1e7d55342124 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:33.524435 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c25003f4-4580-401a-a2ae-1e7d55342124 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:33.528928 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-80613c48-55c3-49b4-ba8e-6702e4bc292c req-ed823bf6-9261-4339-92d8-c7db2ff07e6c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050472 Jun 01 04:35:33.530685 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 374/763] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:35:33.658496 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-c25003f4-4580-401a-a2ae-1e7d55342124 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:33.665915 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-c25003f4-4580-401a-a2ae-1e7d55342124 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1547 microversion: 2.1 time: 0.163191 Jun 01 04:35:33.666477 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 390/764] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:33 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1547 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:35:33.682080 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-1e3b5221-fe50-4cf7-a661-7f7125fbdded tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:33.685449 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-1e3b5221-fe50-4cf7-a661-7f7125fbdded tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:33.686181 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-1e3b5221-fe50-4cf7-a661-7f7125fbdded tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Searching by: {'deleted': False, 'project_id': 'cd5966396128491d814472e980cfd873'} {{(pid=118517) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 01 04:35:33.693901 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1e3b5221-fe50-4cf7-a661-7f7125fbdded tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:33.694344 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1e3b5221-fe50-4cf7-a661-7f7125fbdded tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:33.695124 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1e3b5221-fe50-4cf7-a661-7f7125fbdded tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:33.695607 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1e3b5221-fe50-4cf7-a661-7f7125fbdded tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:33.785002 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.multi_cell_list [None req-1e3b5221-fe50-4cf7-a661-7f7125fbdded tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 01 04:35:33.836774 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=100 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:35:33.847562 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-2638a4c7-8693-415e-b0fa-d86443f5d919 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:33.848342 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-2638a4c7-8693-415e-b0fa-d86443f5d919 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:33.854742 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2638a4c7-8693-415e-b0fa-d86443f5d919 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:33.855205 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2638a4c7-8693-415e-b0fa-d86443f5d919 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:33.856013 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2638a4c7-8693-415e-b0fa-d86443f5d919 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:33.856458 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2638a4c7-8693-415e-b0fa-d86443f5d919 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:33.878078 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-1e3b5221-fe50-4cf7-a661-7f7125fbdded tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.200103 Jun 01 04:35:33.878666 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 375/765] 10.222.0.18 () {58 vars in 1124 bytes} [Wed Jun 1 04:35:33 2022] GET /compute/v2.1/servers => generated 343 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:35:33.888435 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-d45cdfed-045b-48da-85e4-537c445c17a7 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:33.889285 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-d45cdfed-045b-48da-85e4-537c445c17a7 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:33.896531 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d45cdfed-045b-48da-85e4-537c445c17a7 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:33.896974 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d45cdfed-045b-48da-85e4-537c445c17a7 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:33.897739 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d45cdfed-045b-48da-85e4-537c445c17a7 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:33.898173 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d45cdfed-045b-48da-85e4-537c445c17a7 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:33.995055 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-2638a4c7-8693-415e-b0fa-d86443f5d919 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:34.002705 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-2638a4c7-8693-415e-b0fa-d86443f5d919 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1265 microversion: 2.1 time: 0.158999 Jun 01 04:35:34.003275 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 391/766] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:33 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:35:34.033034 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-d45cdfed-045b-48da-85e4-537c445c17a7 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:34.043066 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-d45cdfed-045b-48da-85e4-537c445c17a7 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1547 microversion: 2.1 time: 0.155786 Jun 01 04:35:34.043066 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 376/767] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:33 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:35:35.020216 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-88d3b00c-140a-4c81-89d3-dcc1dfe4fa0e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:35.020859 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-88d3b00c-140a-4c81-89d3-dcc1dfe4fa0e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:35.027087 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-88d3b00c-140a-4c81-89d3-dcc1dfe4fa0e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:35.027584 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-88d3b00c-140a-4c81-89d3-dcc1dfe4fa0e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:35.028357 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-88d3b00c-140a-4c81-89d3-dcc1dfe4fa0e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:35.028799 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-88d3b00c-140a-4c81-89d3-dcc1dfe4fa0e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:35.170344 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-88d3b00c-140a-4c81-89d3-dcc1dfe4fa0e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:35.173257 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-88d3b00c-140a-4c81-89d3-dcc1dfe4fa0e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1265 microversion: 2.1 time: 0.156936 Jun 01 04:35:35.173818 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 392/768] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:35 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:36.190464 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a2598fd5-83c5-4221-9a51-115433451c69 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:36.191247 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-a2598fd5-83c5-4221-9a51-115433451c69 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:36.197271 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a2598fd5-83c5-4221-9a51-115433451c69 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:36.197721 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a2598fd5-83c5-4221-9a51-115433451c69 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:36.198484 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a2598fd5-83c5-4221-9a51-115433451c69 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:36.198922 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a2598fd5-83c5-4221-9a51-115433451c69 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:36.328624 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-a2598fd5-83c5-4221-9a51-115433451c69 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:36.336049 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-a2598fd5-83c5-4221-9a51-115433451c69 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1265 microversion: 2.1 time: 0.149919 Jun 01 04:35:36.336622 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 377/769] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:36 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:37.353185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-0d536747-84b7-4059-a7c3-d05789438986 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:37.353960 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-0d536747-84b7-4059-a7c3-d05789438986 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:37.360911 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0d536747-84b7-4059-a7c3-d05789438986 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:37.361619 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0d536747-84b7-4059-a7c3-d05789438986 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:37.362547 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0d536747-84b7-4059-a7c3-d05789438986 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:37.363177 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0d536747-84b7-4059-a7c3-d05789438986 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:37.538584 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-0d536747-84b7-4059-a7c3-d05789438986 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:37.546352 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-0d536747-84b7-4059-a7c3-d05789438986 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1265 microversion: 2.1 time: 0.197032 Jun 01 04:35:37.546927 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 393/770] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:37 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:38.564030 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-7fd2085f-d1bc-42b9-b327-1adf2bef8af2 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:38.564638 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-7fd2085f-d1bc-42b9-b327-1adf2bef8af2 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:38.571215 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7fd2085f-d1bc-42b9-b327-1adf2bef8af2 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:38.571693 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7fd2085f-d1bc-42b9-b327-1adf2bef8af2 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:38.572517 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7fd2085f-d1bc-42b9-b327-1adf2bef8af2 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:38.572952 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7fd2085f-d1bc-42b9-b327-1adf2bef8af2 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:38.712968 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-7fd2085f-d1bc-42b9-b327-1adf2bef8af2 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:38.720503 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-7fd2085f-d1bc-42b9-b327-1adf2bef8af2 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1265 microversion: 2.1 time: 0.160902 Jun 01 04:35:38.724341 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 378/771] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:38 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:39.054306 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-8b46d02b-0021-4321-ac32-7756af9763b4 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9aeb889d-0c03-4024-b4af-ac356c7452e7"}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:35:39.055551 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-8b46d02b-0021-4321-ac32-7756af9763b4 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:39.062808 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8b46d02b-0021-4321-ac32-7756af9763b4 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:39.063268 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8b46d02b-0021-4321-ac32-7756af9763b4 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:39.065232 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8b46d02b-0021-4321-ac32-7756af9763b4 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:39.065694 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8b46d02b-0021-4321-ac32-7756af9763b4 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:39.737604 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-7f82f1e0-49e2-437c-b3c3-763e824396e8 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:39.738154 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-7f82f1e0-49e2-437c-b3c3-763e824396e8 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:39.740557 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_api:SELECT=60 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:35:39.745489 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7f82f1e0-49e2-437c-b3c3-763e824396e8 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:39.745936 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7f82f1e0-49e2-437c-b3c3-763e824396e8 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:39.746703 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7f82f1e0-49e2-437c-b3c3-763e824396e8 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:39.747135 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7f82f1e0-49e2-437c-b3c3-763e824396e8 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:39.880880 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-7f82f1e0-49e2-437c-b3c3-763e824396e8 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:39.888642 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-7f82f1e0-49e2-437c-b3c3-763e824396e8 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1451 microversion: 2.1 time: 0.155262 Jun 01 04:35:39.889305 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 379/772] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:39 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:35:39.905928 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a3db1c3a-bbe8-4038-b696-3df08b0e8672 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:39.907948 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-a3db1c3a-bbe8-4038-b696-3df08b0e8672 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:39.912609 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a3db1c3a-bbe8-4038-b696-3df08b0e8672 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:39.913366 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a3db1c3a-bbe8-4038-b696-3df08b0e8672 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:39.914139 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a3db1c3a-bbe8-4038-b696-3df08b0e8672 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:39.914574 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a3db1c3a-bbe8-4038-b696-3df08b0e8672 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:40.054022 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-a3db1c3a-bbe8-4038-b696-3df08b0e8672 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:40.063335 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-a3db1c3a-bbe8-4038-b696-3df08b0e8672 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1451 microversion: 2.1 time: 0.161714 Jun 01 04:35:40.065244 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 380/773] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:39 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:35:40.118172 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-8b46d02b-0021-4321-ac32-7756af9763b4 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "POST /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.068079 Jun 01 04:35:40.119103 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 394/774] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 1 04:35:39 2022] POST /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7/os-volume_attachments => generated 194 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:35:42.340141 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-97d64684-8462-4e48-a167-eaf07d1860e7 req-2428cb87-b108-4468-ada7-d93caa02be76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cc59b84-5abc-477a-bcab-4bb682e2cfda", "tag": "37997631-7c0b-45f2-8dde-80c75b82d919"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:35:42.348739 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-97d64684-8462-4e48-a167-eaf07d1860e7 req-2428cb87-b108-4468-ada7-d93caa02be76 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:42.349182 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-97d64684-8462-4e48-a167-eaf07d1860e7 req-2428cb87-b108-4468-ada7-d93caa02be76 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:42.364946 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-97d64684-8462-4e48-a167-eaf07d1860e7 req-2428cb87-b108-4468-ada7-d93caa02be76 service nova] Creating event network-changed:37997631-7c0b-45f2-8dde-80c75b82d919 for instance 4cc59b84-5abc-477a-bcab-4bb682e2cfda on hv-cinder-66710 Jun 01 04:35:42.366338 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-97d64684-8462-4e48-a167-eaf07d1860e7 req-2428cb87-b108-4468-ada7-d93caa02be76 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029774 Jun 01 04:35:42.370787 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 381/775] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:35:48.746725 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-235c1079-2b00-41cb-a111-c5951d5e2296 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:48.747472 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-235c1079-2b00-41cb-a111-c5951d5e2296 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:48.754290 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-235c1079-2b00-41cb-a111-c5951d5e2296 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:48.754747 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-235c1079-2b00-41cb-a111-c5951d5e2296 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:48.755562 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-235c1079-2b00-41cb-a111-c5951d5e2296 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:48.755999 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-235c1079-2b00-41cb-a111-c5951d5e2296 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:48.884897 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-235c1079-2b00-41cb-a111-c5951d5e2296 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:48.893062 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-235c1079-2b00-41cb-a111-c5951d5e2296 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1593 microversion: 2.1 time: 0.151254 Jun 01 04:35:48.893637 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 395/776] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:48 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1593 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:35:51.091260 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell0:SELECT=2 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:35:51.096140 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-0867d0b5-71a8-4df9-949e-aaa614382c18 req-db173b91-0671-427d-bcec-c0715ea1dec6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a901966-c203-41d4-9db4-e2a896daffa7", "tag": "fe4b660b-fcd7-4ccb-8056-f5657999e42f"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:35:51.104364 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-0867d0b5-71a8-4df9-949e-aaa614382c18 req-db173b91-0671-427d-bcec-c0715ea1dec6 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:51.104809 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-0867d0b5-71a8-4df9-949e-aaa614382c18 req-db173b91-0671-427d-bcec-c0715ea1dec6 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:51.117032 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-0867d0b5-71a8-4df9-949e-aaa614382c18 req-db173b91-0671-427d-bcec-c0715ea1dec6 service nova] Creating event network-changed:fe4b660b-fcd7-4ccb-8056-f5657999e42f for instance 8a901966-c203-41d4-9db4-e2a896daffa7 on hv-cinder-66710 Jun 01 04:35:51.121921 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-0867d0b5-71a8-4df9-949e-aaa614382c18 req-db173b91-0671-427d-bcec-c0715ea1dec6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031888 Jun 01 04:35:51.122733 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 382/777] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:35:53.712668 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-340f240f-ed27-4f9b-bf54-19fafdc0ce09 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1421609787"}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:35:53.713309 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-340f240f-ed27-4f9b-bf54-19fafdc0ce09 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:53.722343 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-340f240f-ed27-4f9b-bf54-19fafdc0ce09 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:53.722900 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-340f240f-ed27-4f9b-bf54-19fafdc0ce09 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:53.723756 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-340f240f-ed27-4f9b-bf54-19fafdc0ce09 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:53.724205 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-340f240f-ed27-4f9b-bf54-19fafdc0ce09 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:53.860285 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.network.security_group_api [None req-340f240f-ed27-4f9b-bf54-19fafdc0ce09 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Adding security group 7f9c6c9f-23db-4d5a-852b-3d3f4c028a1e to port fe4b660b-fcd7-4ccb-8056-f5657999e42f Jun 01 04:35:54.344150 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-340f240f-ed27-4f9b-bf54-19fafdc0ce09 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "POST /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7/action" status: 202 len: 0 microversion: 2.1 time: 0.635628 Jun 01 04:35:54.345356 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 396/778] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 1 04:35:53 2022] POST /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7/action => generated 0 bytes in 637 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 01 04:35:54.384643 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-b5d20621-1d74-419e-8784-14c02a559a51 req-c860d661-d98d-4f70-abf3-a5dea36d82ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a901966-c203-41d4-9db4-e2a896daffa7", "tag": "fe4b660b-fcd7-4ccb-8056-f5657999e42f"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:35:54.385304 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-2f73db4c-130b-40bf-8643-4f2952aa04da tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:35:54.385304 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-2f73db4c-130b-40bf-8643-4f2952aa04da tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:35:54.385304 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2f73db4c-130b-40bf-8643-4f2952aa04da tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:54.385304 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2f73db4c-130b-40bf-8643-4f2952aa04da tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:54.387169 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2f73db4c-130b-40bf-8643-4f2952aa04da tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:54.387169 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2f73db4c-130b-40bf-8643-4f2952aa04da tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:54.387486 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-b5d20621-1d74-419e-8784-14c02a559a51 req-c860d661-d98d-4f70-abf3-a5dea36d82ee service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:35:54.387486 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-b5d20621-1d74-419e-8784-14c02a559a51 req-c860d661-d98d-4f70-abf3-a5dea36d82ee service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:35:54.402598 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-b5d20621-1d74-419e-8784-14c02a559a51 req-c860d661-d98d-4f70-abf3-a5dea36d82ee service nova] Creating event network-changed:fe4b660b-fcd7-4ccb-8056-f5657999e42f for instance 8a901966-c203-41d4-9db4-e2a896daffa7 on hv-cinder-66710 Jun 01 04:35:54.409451 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-b5d20621-1d74-419e-8784-14c02a559a51 req-c860d661-d98d-4f70-abf3-a5dea36d82ee service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053070 Jun 01 04:35:54.410436 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 397/779] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:35:54.567737 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-2f73db4c-130b-40bf-8643-4f2952aa04da tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:35:54.577248 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-2f73db4c-130b-40bf-8643-4f2952aa04da tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1759 microversion: 2.1 time: 0.227006 Jun 01 04:35:54.577836 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 383/780] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:35:54 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1759 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:36:23.124104 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_api:SELECT=17 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:36:23.124104 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:36:23.128576 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-8753bc8c-6f07-4dcb-b1e9-a49e723bd8c6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:23.129574 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-8753bc8c-6f07-4dcb-b1e9-a49e723bd8c6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:23.135847 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8753bc8c-6f07-4dcb-b1e9-a49e723bd8c6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:23.136299 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8753bc8c-6f07-4dcb-b1e9-a49e723bd8c6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:23.137072 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8753bc8c-6f07-4dcb-b1e9-a49e723bd8c6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:23.137513 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8753bc8c-6f07-4dcb-b1e9-a49e723bd8c6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:23.167645 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-8753bc8c-6f07-4dcb-b1e9-a49e723bd8c6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045743 Jun 01 04:36:23.168238 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 398/781] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 1 04:36:23 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 01 04:36:23.226620 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-11ec124b-2d68-4253-8618-85e606f09c77 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:23.227125 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-11ec124b-2d68-4253-8618-85e606f09c77 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:23.229236 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_api:SELECT=9 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:36:23.229951 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=41 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:36:23.244448 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-11ec124b-2d68-4253-8618-85e606f09c77 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:23.248974 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-11ec124b-2d68-4253-8618-85e606f09c77 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:23.248974 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-11ec124b-2d68-4253-8618-85e606f09c77 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:23.248974 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-11ec124b-2d68-4253-8618-85e606f09c77 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:23.274288 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-11ec124b-2d68-4253-8618-85e606f09c77 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Going to try to terminate instance {{(pid=118517) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 01 04:36:23.553485 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-11ec124b-2d68-4253-8618-85e606f09c77 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 204 len: 0 microversion: 2.1 time: 0.330448 Jun 01 04:36:23.554076 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 384/782] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 1 04:36:23 2022] DELETE /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 01 04:36:23.562710 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b7bb0c0e-cd29-433c-b91c-deff3d9664b3 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:23.563334 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-b7bb0c0e-cd29-433c-b91c-deff3d9664b3 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:23.569982 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b7bb0c0e-cd29-433c-b91c-deff3d9664b3 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:23.570431 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b7bb0c0e-cd29-433c-b91c-deff3d9664b3 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:23.571188 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b7bb0c0e-cd29-433c-b91c-deff3d9664b3 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:23.571646 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b7bb0c0e-cd29-433c-b91c-deff3d9664b3 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:23.712440 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b7bb0c0e-cd29-433c-b91c-deff3d9664b3 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:23.720224 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-b7bb0c0e-cd29-433c-b91c-deff3d9664b3 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1671 microversion: 2.1 time: 0.161766 Jun 01 04:36:23.720792 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 399/783] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:36:23 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:36:23.841192 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-5775efb7-b1bb-4a5f-afab-f6cb6fc0f974 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:23.841686 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-5775efb7-b1bb-4a5f-afab-f6cb6fc0f974 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:23.848360 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5775efb7-b1bb-4a5f-afab-f6cb6fc0f974 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:23.848812 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5775efb7-b1bb-4a5f-afab-f6cb6fc0f974 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:23.849582 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5775efb7-b1bb-4a5f-afab-f6cb6fc0f974 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:23.850022 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5775efb7-b1bb-4a5f-afab-f6cb6fc0f974 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:23.873186 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-5775efb7-b1bb-4a5f-afab-f6cb6fc0f974 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e/ips" status: 200 len: 152 microversion: 2.20 time: 0.036228 Jun 01 04:36:23.873756 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 385/784] 10.222.0.18 () {60 vars in 1288 bytes} [Wed Jun 1 04:36:23 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 01 04:36:24.738709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-8658df33-0196-468a-bbdd-60a258a5969b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:24.739335 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-8658df33-0196-468a-bbdd-60a258a5969b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:24.746225 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8658df33-0196-468a-bbdd-60a258a5969b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:24.746670 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8658df33-0196-468a-bbdd-60a258a5969b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:24.747467 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8658df33-0196-468a-bbdd-60a258a5969b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:24.747904 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8658df33-0196-468a-bbdd-60a258a5969b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:24.879385 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-8658df33-0196-468a-bbdd-60a258a5969b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:24.886944 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-8658df33-0196-468a-bbdd-60a258a5969b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1671 microversion: 2.1 time: 0.153342 Jun 01 04:36:24.887542 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 400/785] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:36:24 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:36:25.904509 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-00d7e63f-9731-41d4-a36f-5a96c838a653 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:25.905123 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-00d7e63f-9731-41d4-a36f-5a96c838a653 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:25.912183 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-00d7e63f-9731-41d4-a36f-5a96c838a653 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:25.912568 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-00d7e63f-9731-41d4-a36f-5a96c838a653 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:25.913347 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-00d7e63f-9731-41d4-a36f-5a96c838a653 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:25.913785 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-00d7e63f-9731-41d4-a36f-5a96c838a653 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:25.987274 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-00d7e63f-9731-41d4-a36f-5a96c838a653 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:25.999498 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-00d7e63f-9731-41d4-a36f-5a96c838a653 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1604 microversion: 2.1 time: 0.098517 Jun 01 04:36:26.001522 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 386/786] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:36:25 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1604 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:36:26.039469 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-1e00048f-55aa-459f-981f-4deb0bcde161 req-08d4e0d4-c8b8-4a19-93a2-46adf310e321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d63ef9-2dd3-490e-8a17-895f7b2c3b95", "name": "network-vif-deleted", "tag": "c19ca474-59d8-487c-9b33-f1c1452fe94d"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:36:26.048511 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-1e00048f-55aa-459f-981f-4deb0bcde161 req-08d4e0d4-c8b8-4a19-93a2-46adf310e321 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:26.048961 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-1e00048f-55aa-459f-981f-4deb0bcde161 req-08d4e0d4-c8b8-4a19-93a2-46adf310e321 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:26.063082 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-1e00048f-55aa-459f-981f-4deb0bcde161 req-08d4e0d4-c8b8-4a19-93a2-46adf310e321 service nova] Creating event network-vif-deleted:c19ca474-59d8-487c-9b33-f1c1452fe94d for instance f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 on hv-cinder-66710 Jun 01 04:36:26.068611 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-1e00048f-55aa-459f-981f-4deb0bcde161 req-08d4e0d4-c8b8-4a19-93a2-46adf310e321 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034645 Jun 01 04:36:26.070457 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 401/787] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:36:26.120352 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-bc15479c-47d1-4160-aca9-1f12a3a8a7bc tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:36:26.121065 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-bc15479c-47d1-4160-aca9-1f12a3a8a7bc tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:26.128337 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bc15479c-47d1-4160-aca9-1f12a3a8a7bc tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:26.128945 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bc15479c-47d1-4160-aca9-1f12a3a8a7bc tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:26.129847 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bc15479c-47d1-4160-aca9-1f12a3a8a7bc tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:26.130385 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bc15479c-47d1-4160-aca9-1f12a3a8a7bc tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:26.156625 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.objects.instance [None req-bc15479c-47d1-4160-aca9-1f12a3a8a7bc tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lazy-loading 'flavor' on Instance uuid a3958973-f8ca-4c63-b27b-72c3e272604e {{(pid=118517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:36:26.698805 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-bc15479c-47d1-4160-aca9-1f12a3a8a7bc tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "POST /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e/action" status: 202 len: 0 microversion: 2.20 time: 0.582704 Jun 01 04:36:26.699754 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 387/788] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Jun 1 04:36:26 2022] POST /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e/action => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 01 04:36:26.708087 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-eb62919b-0848-4329-82d6-e9a7f68b69da tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:26.708780 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-eb62919b-0848-4329-82d6-e9a7f68b69da tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:26.714956 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-eb62919b-0848-4329-82d6-e9a7f68b69da tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:26.715469 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-eb62919b-0848-4329-82d6-e9a7f68b69da tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:26.716228 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-eb62919b-0848-4329-82d6-e9a7f68b69da tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:26.716663 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-eb62919b-0848-4329-82d6-e9a7f68b69da tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:26.873752 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-eb62919b-0848-4329-82d6-e9a7f68b69da tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:26.882425 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-eb62919b-0848-4329-82d6-e9a7f68b69da tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:26.884294 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-eb62919b-0848-4329-82d6-e9a7f68b69da tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:26.885421 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-eb62919b-0848-4329-82d6-e9a7f68b69da tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1725 microversion: 2.20 time: 0.181609 Jun 01 04:36:26.885977 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 402/789] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:36:26 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:36:27.034434 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-9f373f0f-db6b-400a-87fd-e47bf462f1de tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:27.034434 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-9f373f0f-db6b-400a-87fd-e47bf462f1de tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:27.034434 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9f373f0f-db6b-400a-87fd-e47bf462f1de tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:27.034434 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9f373f0f-db6b-400a-87fd-e47bf462f1de tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:27.035253 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9f373f0f-db6b-400a-87fd-e47bf462f1de tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:27.035610 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9f373f0f-db6b-400a-87fd-e47bf462f1de tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:27.084164 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9f373f0f-db6b-400a-87fd-e47bf462f1de tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:27.084880 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9f373f0f-db6b-400a-87fd-e47bf462f1de tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:27.085337 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.objects.instance [None req-9f373f0f-db6b-400a-87fd-e47bf462f1de tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lazy-loading 'fault' on Instance uuid f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 {{(pid=118517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:36:27.130929 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-9f373f0f-db6b-400a-87fd-e47bf462f1de tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:27.139540 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-9f373f0f-db6b-400a-87fd-e47bf462f1de tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 200 len: 1326 microversion: 2.1 time: 0.119345 Jun 01 04:36:27.140187 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 388/790] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:36:27 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 1326 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:36:27.904564 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-5fedca13-708e-4fa1-be01-455aa50d2141 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:27.905165 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-5fedca13-708e-4fa1-be01-455aa50d2141 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:27.912165 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5fedca13-708e-4fa1-be01-455aa50d2141 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:27.912615 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5fedca13-708e-4fa1-be01-455aa50d2141 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:27.913375 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5fedca13-708e-4fa1-be01-455aa50d2141 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:27.913806 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5fedca13-708e-4fa1-be01-455aa50d2141 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:28.044419 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-5fedca13-708e-4fa1-be01-455aa50d2141 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:28.052646 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-5fedca13-708e-4fa1-be01-455aa50d2141 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:28.054203 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-5fedca13-708e-4fa1-be01-455aa50d2141 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:28.055409 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-5fedca13-708e-4fa1-be01-455aa50d2141 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1725 microversion: 2.20 time: 0.154837 Jun 01 04:36:28.055963 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 403/791] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:36:27 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:36:28.158035 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-002b2913-9fa3-45c5-8ba5-6219ad4cf44b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:28.158713 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-002b2913-9fa3-45c5-8ba5-6219ad4cf44b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:28.165187 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-002b2913-9fa3-45c5-8ba5-6219ad4cf44b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:28.172640 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-002b2913-9fa3-45c5-8ba5-6219ad4cf44b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:28.172640 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-002b2913-9fa3-45c5-8ba5-6219ad4cf44b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:28.172640 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-002b2913-9fa3-45c5-8ba5-6219ad4cf44b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:28.180794 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.wsgi [None req-002b2913-9fa3-45c5-8ba5-6219ad4cf44b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] HTTP exception thrown: Instance f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 could not be found. Jun 01 04:36:28.182467 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-002b2913-9fa3-45c5-8ba5-6219ad4cf44b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Request method failure captured: Jun 01 04:36:28.182467 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: request: GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 HTTP/1.1 Jun 01 04:36:28.182467 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept: application/json Jun 01 04:36:28.182467 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept-Encoding: identity Jun 01 04:36:28.182467 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Connection: close Jun 01 04:36:28.182467 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Length: 0 Jun 01 04:36:28.182467 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Type: application/json Jun 01 04:36:28.182467 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Host: 10.222.0.18 Jun 01 04:36:28.182467 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Openstack-System-Scope: None Jun 01 04:36:28.182467 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: User-Agent: python-urllib3/1.26.9 Jun 01 04:36:28.182467 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Auth-Token: gAAAAABilusaiXdJqCNwqWQdT51DbPmRD8pAHbwXzV3-587Eryc6oQNrE2kDJqR5Zfdfd4dT29qb52XgUVUJF2T7sVG0r2SImbd24oNQxvNf2TJGfTjV3WSWKUwmSGPc1LymdmFN8eDVOZqJgg-NDvjYVD9HDPa-uaUVGSa_UtV3DhVH_VMssqM Jun 01 04:36:28.182467 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Id: None Jun 01 04:36:28.182467 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Name: None Jun 01 04:36:28.182467 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Identity-Status: Confirmed Jun 01 04:36:28.182467 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Is-Admin-Project: True Jun 01 04:36:28.182467 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Id: default Jun 01 04:36:28.182467 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Name: Default Jun 01 04:36:28.182467 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Id: 89e9dc06c3304c42a7fb6cbed1e357a4 Jun 01 04:36:28.182467 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Name: tempest-AttachVolumeTestJSON-1274552074 Jun 01 04:36:28.182467 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Role: reader,member Jun 01 04:36:28.182467 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Roles: reader,member Jun 01 04:36:28.184214 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89e9dc06c3304c42a7fb6cbed1e357a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89e9dc06c3304c42a7fb6cbed1e357a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89e9dc06c3304c42a7fb6cbed1e357a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89e9dc06c3304c42a7fb6cbed1e357a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:36:28.184214 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant: tempest-AttachVolumeTestJSON-1274552074 Jun 01 04:36:28.184214 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Id: 89e9dc06c3304c42a7fb6cbed1e357a4 Jun 01 04:36:28.184214 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1274552074 Jun 01 04:36:28.184214 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User: tempest-AttachVolumeTestJSON-1274552074-project Jun 01 04:36:28.184214 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Id: default Jun 01 04:36:28.184214 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Name: Default Jun 01 04:36:28.184214 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Id: a0a147daff9846e699c26259fac4e004 Jun 01 04:36:28.184214 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Name: tempest-AttachVolumeTestJSON-1274552074-project Jun 01 04:36:28.184214 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: method: > Jun 01 04:36:28.184214 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: exception: Instance f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 could not be found. Jun 01 04:36:28.184214 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: action_args: {'id': 'f5d63ef9-2dd3-490e-8a17-895f7b2c3b95'} Jun 01 04:36:28.185319 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:36:28.185319 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:36:28.185319 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:36:28.185319 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:36:28.185319 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:36:28.185319 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:36:28.185319 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:36:28.185319 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:36:28.185319 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:36:28.185319 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:36:28.185319 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 could not be found. Jun 01 04:36:28.185319 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:36:28.185319 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:36:28.185319 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:36:28.185319 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:36:28.185319 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:36:28.185319 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:36:28.185319 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:36:28.185319 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:36:28.185319 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:36:28.186846 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:36:28.186846 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 01 04:36:28.186846 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 01 04:36:28.186846 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:36:28.186846 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:36:28.186846 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:36:28.186846 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:36:28.186846 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 could not be found. Jun 01 04:36:28.186846 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:36:28.186846 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:36:28.186846 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:36:28.186846 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:36:28.186846 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:36:28.186846 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:36:28.186846 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:36:28.186846 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:36:28.186846 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 could not be found. Jun 01 04:36:28.186846 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:36:28.188944 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-002b2913-9fa3-45c5-8ba5-6219ad4cf44b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Returning 404 to user: Instance f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 could not be found. {{(pid=118517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:36:28.188944 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-002b2913-9fa3-45c5-8ba5-6219ad4cf44b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 404 len: 111 microversion: 2.1 time: 0.030331 Jun 01 04:36:28.188944 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 389/792] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:36:28 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:36:28.193365 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-e78418f9-9286-4baa-ad89-f0c83e1da3c4 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '.version_select at 0x7ff3258bc550>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:28.279976 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-e78418f9-9286-4baa-ad89-f0c83e1da3c4 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-407470703" status: 202 len: 0 microversion: 2.1 time: 0.090342 Jun 01 04:36:28.280657 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 404/793] 10.222.0.18 () {58 vars in 1217 bytes} [Wed Jun 1 04:36:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-407470703 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 01 04:36:29.074391 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-fd439e7c-4666-46dc-b2a1-8ff6c22fb8ed tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:29.075003 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-fd439e7c-4666-46dc-b2a1-8ff6c22fb8ed tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:29.082318 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-fd439e7c-4666-46dc-b2a1-8ff6c22fb8ed tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:29.082776 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-fd439e7c-4666-46dc-b2a1-8ff6c22fb8ed tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:29.087045 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-fd439e7c-4666-46dc-b2a1-8ff6c22fb8ed tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:29.087045 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-fd439e7c-4666-46dc-b2a1-8ff6c22fb8ed tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:29.087250 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-267a281e-cbdc-42ac-8916-8c9eb077a02a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Action: 'create', calling method: .version_select at 0x7ff32596b3a0>, body: {"keypair": {"name": "tempest-keypair-754628665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTiApMtUPVkQuVtvOy1rwpJBzZ3RpS4kfZHqExY0EppAjbrB/JdE8Ko9Mh7sSuvoEcX20QAZsh5dTYyE7qkpI9MC9N00k/xRRi4DPaRICm+XkkuIalg9duSoQH1Lxktkg=="}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:36:29.100349 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-267a281e-cbdc-42ac-8916-8c9eb077a02a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Getting quotas for project 89e9dc06c3304c42a7fb6cbed1e357a4. Resources: {'key_pairs'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:36:29.108768 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-267a281e-cbdc-42ac-8916-8c9eb077a02a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Getting quotas for user a0a147daff9846e699c26259fac4e004 and project 89e9dc06c3304c42a7fb6cbed1e357a4. Resources: {'key_pairs'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:36:29.234722 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-fd439e7c-4666-46dc-b2a1-8ff6c22fb8ed tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:29.243035 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-fd439e7c-4666-46dc-b2a1-8ff6c22fb8ed tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:29.244274 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-267a281e-cbdc-42ac-8916-8c9eb077a02a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.163580 Jun 01 04:36:29.244568 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-fd439e7c-4666-46dc-b2a1-8ff6c22fb8ed tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:29.244917 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 405/794] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jun 1 04:36:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:36:29.245724 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-fd439e7c-4666-46dc-b2a1-8ff6c22fb8ed tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1725 microversion: 2.20 time: 0.175791 Jun 01 04:36:29.246268 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 390/795] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:36:29 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:36:30.265286 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-2117fc0c-d62b-409e-91d3-91cb84ae4469 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:30.265899 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-2117fc0c-d62b-409e-91d3-91cb84ae4469 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:30.272113 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2117fc0c-d62b-409e-91d3-91cb84ae4469 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:30.272571 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2117fc0c-d62b-409e-91d3-91cb84ae4469 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:30.273343 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2117fc0c-d62b-409e-91d3-91cb84ae4469 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:30.273784 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2117fc0c-d62b-409e-91d3-91cb84ae4469 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:30.417670 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-2117fc0c-d62b-409e-91d3-91cb84ae4469 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:30.425790 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-2117fc0c-d62b-409e-91d3-91cb84ae4469 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:30.427484 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-2117fc0c-d62b-409e-91d3-91cb84ae4469 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:30.428689 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-2117fc0c-d62b-409e-91d3-91cb84ae4469 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1725 microversion: 2.20 time: 0.168000 Jun 01 04:36:30.429578 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 406/796] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:36:30 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:36:31.449419 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-81e3ed19-522e-4b26-b44b-347440ccf366 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:31.452581 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-81e3ed19-522e-4b26-b44b-347440ccf366 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:31.461740 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-81e3ed19-522e-4b26-b44b-347440ccf366 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:31.462268 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-81e3ed19-522e-4b26-b44b-347440ccf366 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:31.463618 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-81e3ed19-522e-4b26-b44b-347440ccf366 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:31.464316 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-81e3ed19-522e-4b26-b44b-347440ccf366 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:31.680097 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-14ef1214-551d-4205-89e1-239377cdc5ef tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1331321159", "imageRef": "14321baa-3ac5-4c53-8054-4945abce5b2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e9688948-1a1c-4b5b-bf21-d65382a9ef23"}], "security_groups": [{"name": "tempest-securitygroup--1317689955"}], "key_name": "tempest-keypair-754628665", "user_data": "}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:36:31.777324 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-81e3ed19-522e-4b26-b44b-347440ccf366 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:31.785507 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-81e3ed19-522e-4b26-b44b-347440ccf366 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:31.787134 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-81e3ed19-522e-4b26-b44b-347440ccf366 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:31.788400 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-81e3ed19-522e-4b26-b44b-347440ccf366 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1725 microversion: 2.20 time: 0.344899 Jun 01 04:36:31.789034 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 391/797] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:36:31 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1725 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:36:31.827882 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.network.neutron [None req-14ef1214-551d-4205-89e1-239377cdc5ef tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] validate_networks() for [('e9688948-1a1c-4b5b-bf21-d65382a9ef23', None, None, None, None, None)] {{(pid=118516) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 01 04:36:32.243662 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-14ef1214-551d-4205-89e1-239377cdc5ef tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Flavor limits 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 01 04:36:32.244092 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-14ef1214-551d-4205-89e1-239377cdc5ef tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Image limits 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 01 04:36:32.244571 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-14ef1214-551d-4205-89e1-239377cdc5ef tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Flavor pref 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 01 04:36:32.244983 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-14ef1214-551d-4205-89e1-239377cdc5ef tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Image pref 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 01 04:36:32.245400 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-14ef1214-551d-4205-89e1-239377cdc5ef tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 01 04:36:32.255694 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-14ef1214-551d-4205-89e1-239377cdc5ef tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:32.256199 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-14ef1214-551d-4205-89e1-239377cdc5ef tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:32.257011 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-14ef1214-551d-4205-89e1-239377cdc5ef tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:32.257454 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-14ef1214-551d-4205-89e1-239377cdc5ef tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:32.275014 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-14ef1214-551d-4205-89e1-239377cdc5ef tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Getting quotas for project 89e9dc06c3304c42a7fb6cbed1e357a4. Resources: {'ram', 'instances', 'cores'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:36:32.279170 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-14ef1214-551d-4205-89e1-239377cdc5ef tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Getting quotas for user a0a147daff9846e699c26259fac4e004 and project 89e9dc06c3304c42a7fb6cbed1e357a4. Resources: {'ram', 'instances', 'cores'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:36:32.291713 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-14ef1214-551d-4205-89e1-239377cdc5ef tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Going to run 1 instances... {{(pid=118516) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 01 04:36:32.294070 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-14ef1214-551d-4205-89e1-239377cdc5ef tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14321baa-3ac5-4c53-8054-4945abce5b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 01 04:36:32.428076 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-14ef1214-551d-4205-89e1-239377cdc5ef tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.752303 Jun 01 04:36:32.428779 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 407/798] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 1 04:36:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 01 04:36:32.438814 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-fa188263-2092-4761-9e46-c63a679df8c3 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:32.439444 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-fa188263-2092-4761-9e46-c63a679df8c3 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:32.494463 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-fa188263-2092-4761-9e46-c63a679df8c3 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:32.501075 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-fa188263-2092-4761-9e46-c63a679df8c3 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4" status: 200 len: 1237 microversion: 2.1 time: 0.065963 Jun 01 04:36:32.501634 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 392/799] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:36:32 2022] GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4 => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:36:32.807501 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-cc6db9f9-35dc-4f5d-b88e-42632b73ae3b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:32.808668 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-cc6db9f9-35dc-4f5d-b88e-42632b73ae3b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:32.815933 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cc6db9f9-35dc-4f5d-b88e-42632b73ae3b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:32.816391 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cc6db9f9-35dc-4f5d-b88e-42632b73ae3b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:32.817195 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cc6db9f9-35dc-4f5d-b88e-42632b73ae3b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:32.817624 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cc6db9f9-35dc-4f5d-b88e-42632b73ae3b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:32.989502 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-cc6db9f9-35dc-4f5d-b88e-42632b73ae3b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:32.998124 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-cc6db9f9-35dc-4f5d-b88e-42632b73ae3b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:33.000219 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-cc6db9f9-35dc-4f5d-b88e-42632b73ae3b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:33.001386 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-cc6db9f9-35dc-4f5d-b88e-42632b73ae3b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1725 microversion: 2.20 time: 0.198769 Jun 01 04:36:33.001987 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 408/800] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:36:32 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1725 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:36:33.518565 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-fddef2ff-9c58-41de-b71e-518acf14ee49 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:33.519180 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-fddef2ff-9c58-41de-b71e-518acf14ee49 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:33.526447 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-fddef2ff-9c58-41de-b71e-518acf14ee49 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:33.526899 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-fddef2ff-9c58-41de-b71e-518acf14ee49 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:33.527769 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-fddef2ff-9c58-41de-b71e-518acf14ee49 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:33.528518 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-fddef2ff-9c58-41de-b71e-518acf14ee49 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:33.598128 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-fddef2ff-9c58-41de-b71e-518acf14ee49 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:33.607383 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-fddef2ff-9c58-41de-b71e-518acf14ee49 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4" status: 200 len: 1241 microversion: 2.1 time: 0.093273 Jun 01 04:36:33.608280 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 393/801] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:36:33 2022] GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4 => generated 1241 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:36:34.020049 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-2925414d-415d-4325-b93f-86f78b8b7400 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:34.020801 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-2925414d-415d-4325-b93f-86f78b8b7400 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:34.027905 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2925414d-415d-4325-b93f-86f78b8b7400 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:34.028471 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2925414d-415d-4325-b93f-86f78b8b7400 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:34.029370 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2925414d-415d-4325-b93f-86f78b8b7400 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:34.029884 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2925414d-415d-4325-b93f-86f78b8b7400 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:34.171841 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-2925414d-415d-4325-b93f-86f78b8b7400 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:34.180209 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-2925414d-415d-4325-b93f-86f78b8b7400 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:34.181815 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-2925414d-415d-4325-b93f-86f78b8b7400 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:34.183149 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-2925414d-415d-4325-b93f-86f78b8b7400 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1725 microversion: 2.20 time: 0.167544 Jun 01 04:36:34.183807 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 409/802] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:36:34 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:36:34.630421 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-3ce3ddb4-de55-4d56-9daf-c3ef81cde101 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:34.630421 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-3ce3ddb4-de55-4d56-9daf-c3ef81cde101 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:34.640764 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3ce3ddb4-de55-4d56-9daf-c3ef81cde101 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:34.642634 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3ce3ddb4-de55-4d56-9daf-c3ef81cde101 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:34.643502 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3ce3ddb4-de55-4d56-9daf-c3ef81cde101 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:34.643950 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3ce3ddb4-de55-4d56-9daf-c3ef81cde101 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:34.725731 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-3ce3ddb4-de55-4d56-9daf-c3ef81cde101 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:34.735622 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-3ce3ddb4-de55-4d56-9daf-c3ef81cde101 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4" status: 200 len: 1297 microversion: 2.1 time: 0.115072 Jun 01 04:36:34.736330 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 394/803] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:36:34 2022] GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4 => generated 1297 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:36:35.201486 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-98402759-cf94-4956-9311-cdbb9c9f3c79 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:35.202097 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-98402759-cf94-4956-9311-cdbb9c9f3c79 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:35.210221 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-98402759-cf94-4956-9311-cdbb9c9f3c79 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:35.210666 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-98402759-cf94-4956-9311-cdbb9c9f3c79 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:35.211491 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-98402759-cf94-4956-9311-cdbb9c9f3c79 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:35.211935 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-98402759-cf94-4956-9311-cdbb9c9f3c79 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:35.448478 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-98402759-cf94-4956-9311-cdbb9c9f3c79 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:35.457830 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-98402759-cf94-4956-9311-cdbb9c9f3c79 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:35.459392 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-98402759-cf94-4956-9311-cdbb9c9f3c79 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:35.460699 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-98402759-cf94-4956-9311-cdbb9c9f3c79 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1725 microversion: 2.20 time: 0.263177 Jun 01 04:36:35.461466 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 410/804] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:36:35 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1725 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:36:35.755172 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-be22babd-b889-4d61-a554-b57ebac7d147 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:35.755805 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-be22babd-b889-4d61-a554-b57ebac7d147 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:35.762970 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-be22babd-b889-4d61-a554-b57ebac7d147 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:35.763469 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-be22babd-b889-4d61-a554-b57ebac7d147 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:35.764642 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-be22babd-b889-4d61-a554-b57ebac7d147 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:35.765138 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-be22babd-b889-4d61-a554-b57ebac7d147 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:35.942568 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-be22babd-b889-4d61-a554-b57ebac7d147 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:35.950166 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-be22babd-b889-4d61-a554-b57ebac7d147 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4" status: 200 len: 1363 microversion: 2.1 time: 0.200498 Jun 01 04:36:35.950730 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 395/805] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:36:35 2022] GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4 => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:36:36.400068 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-dd53714d-a808-4daf-a360-c8877660d453 req-c49448b8-b843-4075-a0a2-2727a7a70c57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf719576-f4a4-4035-9a04-d219fcd92bc4", "tag": "4e9e2f71-edd1-4e77-8eea-aaca161637e1"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:36:36.412773 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-dd53714d-a808-4daf-a360-c8877660d453 req-c49448b8-b843-4075-a0a2-2727a7a70c57 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:36.413536 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-dd53714d-a808-4daf-a360-c8877660d453 req-c49448b8-b843-4075-a0a2-2727a7a70c57 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:36.431358 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-dd53714d-a808-4daf-a360-c8877660d453 req-c49448b8-b843-4075-a0a2-2727a7a70c57 service nova] Creating event network-changed:4e9e2f71-edd1-4e77-8eea-aaca161637e1 for instance bf719576-f4a4-4035-9a04-d219fcd92bc4 on hv-cinder-66710 Jun 01 04:36:36.438261 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-dd53714d-a808-4daf-a360-c8877660d453 req-c49448b8-b843-4075-a0a2-2727a7a70c57 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044193 Jun 01 04:36:36.439784 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 411/806] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:36:36.481601 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-12008f93-9d84-4783-8737-5e493bf9f8a8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:36.482267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-12008f93-9d84-4783-8737-5e493bf9f8a8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:36.489814 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-12008f93-9d84-4783-8737-5e493bf9f8a8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:36.490877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-12008f93-9d84-4783-8737-5e493bf9f8a8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:36.492391 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-12008f93-9d84-4783-8737-5e493bf9f8a8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:36.493050 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-12008f93-9d84-4783-8737-5e493bf9f8a8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:36.644750 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-12008f93-9d84-4783-8737-5e493bf9f8a8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:36.652970 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-12008f93-9d84-4783-8737-5e493bf9f8a8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:36.654376 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-12008f93-9d84-4783-8737-5e493bf9f8a8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:36.655557 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-12008f93-9d84-4783-8737-5e493bf9f8a8 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1725 microversion: 2.20 time: 0.179606 Jun 01 04:36:36.660651 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 396/807] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:36:36 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:36:36.973192 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d4490f24-c1bd-412c-991d-45fd58b834a0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:36.973887 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-d4490f24-c1bd-412c-991d-45fd58b834a0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:36.980420 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d4490f24-c1bd-412c-991d-45fd58b834a0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:36.980870 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d4490f24-c1bd-412c-991d-45fd58b834a0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:36.981636 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d4490f24-c1bd-412c-991d-45fd58b834a0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:36.982237 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d4490f24-c1bd-412c-991d-45fd58b834a0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:37.122197 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-d4490f24-c1bd-412c-991d-45fd58b834a0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:37.130139 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-d4490f24-c1bd-412c-991d-45fd58b834a0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4" status: 200 len: 1363 microversion: 2.1 time: 0.163912 Jun 01 04:36:37.130723 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 412/808] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:36:36 2022] GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:36:37.673979 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-be118f73-132d-4e74-b001-89013efd05fa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:37.674592 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-be118f73-132d-4e74-b001-89013efd05fa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:37.680797 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-be118f73-132d-4e74-b001-89013efd05fa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:37.681253 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-be118f73-132d-4e74-b001-89013efd05fa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:37.683606 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-be118f73-132d-4e74-b001-89013efd05fa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:37.683606 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-be118f73-132d-4e74-b001-89013efd05fa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:37.826925 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-be118f73-132d-4e74-b001-89013efd05fa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:37.836626 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-be118f73-132d-4e74-b001-89013efd05fa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:37.838135 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-be118f73-132d-4e74-b001-89013efd05fa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:37.839311 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-be118f73-132d-4e74-b001-89013efd05fa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1725 microversion: 2.20 time: 0.169276 Jun 01 04:36:37.839873 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 397/809] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:36:37 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:36:38.146775 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-ccc9250a-b86c-49fc-9ed7-52cbd9260e6f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:38.147420 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-ccc9250a-b86c-49fc-9ed7-52cbd9260e6f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:38.153946 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ccc9250a-b86c-49fc-9ed7-52cbd9260e6f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:38.154387 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ccc9250a-b86c-49fc-9ed7-52cbd9260e6f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:38.155162 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ccc9250a-b86c-49fc-9ed7-52cbd9260e6f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:38.155705 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ccc9250a-b86c-49fc-9ed7-52cbd9260e6f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:38.294389 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-ccc9250a-b86c-49fc-9ed7-52cbd9260e6f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:38.302024 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-ccc9250a-b86c-49fc-9ed7-52cbd9260e6f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4" status: 200 len: 1363 microversion: 2.1 time: 0.159235 Jun 01 04:36:38.302594 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 413/810] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:36:38 2022] GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:36:38.857242 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-1de7ba77-aa31-41d3-a4ca-f6b907b2cae5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:38.868552 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-1de7ba77-aa31-41d3-a4ca-f6b907b2cae5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:38.868552 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1de7ba77-aa31-41d3-a4ca-f6b907b2cae5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:38.868552 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1de7ba77-aa31-41d3-a4ca-f6b907b2cae5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:38.868552 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1de7ba77-aa31-41d3-a4ca-f6b907b2cae5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:38.869064 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1de7ba77-aa31-41d3-a4ca-f6b907b2cae5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:38.886067 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:36:39.001752 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-1de7ba77-aa31-41d3-a4ca-f6b907b2cae5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:39.009675 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-1de7ba77-aa31-41d3-a4ca-f6b907b2cae5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:39.011197 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-1de7ba77-aa31-41d3-a4ca-f6b907b2cae5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:39.012394 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-1de7ba77-aa31-41d3-a4ca-f6b907b2cae5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1725 microversion: 2.20 time: 0.159055 Jun 01 04:36:39.012952 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 398/811] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:36:38 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:36:39.318364 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-4fa30c66-ec3e-4306-8f75-2432d97581da tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:39.318978 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-4fa30c66-ec3e-4306-8f75-2432d97581da tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:39.325476 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4fa30c66-ec3e-4306-8f75-2432d97581da tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:39.325951 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4fa30c66-ec3e-4306-8f75-2432d97581da tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:39.326704 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4fa30c66-ec3e-4306-8f75-2432d97581da tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:39.327150 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4fa30c66-ec3e-4306-8f75-2432d97581da tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:39.471713 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-4fa30c66-ec3e-4306-8f75-2432d97581da tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:39.479104 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-4fa30c66-ec3e-4306-8f75-2432d97581da tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4" status: 200 len: 1363 microversion: 2.1 time: 0.164601 Jun 01 04:36:39.479705 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 414/812] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:36:39 2022] GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:36:40.030361 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-68fb22e6-5246-447b-b258-252834bbc294 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:40.034541 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-68fb22e6-5246-447b-b258-252834bbc294 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:40.041703 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-68fb22e6-5246-447b-b258-252834bbc294 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:40.042104 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-68fb22e6-5246-447b-b258-252834bbc294 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:40.042880 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-68fb22e6-5246-447b-b258-252834bbc294 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:40.043379 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-68fb22e6-5246-447b-b258-252834bbc294 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:40.186965 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-68fb22e6-5246-447b-b258-252834bbc294 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:40.195014 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-68fb22e6-5246-447b-b258-252834bbc294 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:40.196690 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-68fb22e6-5246-447b-b258-252834bbc294 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:40.197852 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-68fb22e6-5246-447b-b258-252834bbc294 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1725 microversion: 2.20 time: 0.171798 Jun 01 04:36:40.198399 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 399/813] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:36:40 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:36:40.496607 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-dab647d5-fd8b-48ae-a0e9-986469ef0160 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:40.497565 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-dab647d5-fd8b-48ae-a0e9-986469ef0160 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:40.505172 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-dab647d5-fd8b-48ae-a0e9-986469ef0160 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:40.505867 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-dab647d5-fd8b-48ae-a0e9-986469ef0160 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:40.506728 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-dab647d5-fd8b-48ae-a0e9-986469ef0160 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:40.507263 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-dab647d5-fd8b-48ae-a0e9-986469ef0160 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:40.729883 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-dab647d5-fd8b-48ae-a0e9-986469ef0160 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:40.738780 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-dab647d5-fd8b-48ae-a0e9-986469ef0160 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4" status: 200 len: 1363 microversion: 2.1 time: 0.246740 Jun 01 04:36:40.739383 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 415/814] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:36:40 2022] GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4 => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:36:41.217331 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-77f13454-1315-4062-b1a2-e60334b10dbb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:41.219062 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-77f13454-1315-4062-b1a2-e60334b10dbb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:41.226322 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-77f13454-1315-4062-b1a2-e60334b10dbb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:41.226871 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-77f13454-1315-4062-b1a2-e60334b10dbb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:41.227763 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-77f13454-1315-4062-b1a2-e60334b10dbb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:41.228275 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-77f13454-1315-4062-b1a2-e60334b10dbb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:41.368247 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-77f13454-1315-4062-b1a2-e60334b10dbb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:41.377153 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-77f13454-1315-4062-b1a2-e60334b10dbb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:41.378659 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-77f13454-1315-4062-b1a2-e60334b10dbb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:41.380140 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-77f13454-1315-4062-b1a2-e60334b10dbb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1746 microversion: 2.20 time: 0.167315 Jun 01 04:36:41.380697 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 400/815] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:36:41 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1746 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:36:41.756315 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b0fe816b-3025-4a28-87e1-f97588344ed1 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:41.756931 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-b0fe816b-3025-4a28-87e1-f97588344ed1 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:41.763510 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b0fe816b-3025-4a28-87e1-f97588344ed1 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:41.763967 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b0fe816b-3025-4a28-87e1-f97588344ed1 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:41.764736 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b0fe816b-3025-4a28-87e1-f97588344ed1 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:41.765177 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b0fe816b-3025-4a28-87e1-f97588344ed1 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:41.900959 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b0fe816b-3025-4a28-87e1-f97588344ed1 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:41.908955 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-b0fe816b-3025-4a28-87e1-f97588344ed1 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4" status: 200 len: 1363 microversion: 2.1 time: 0.156542 Jun 01 04:36:41.909529 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 416/816] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:36:41 2022] GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:36:42.115136 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-c97706ee-bade-4de2-bdeb-7758729071c3 req-f6e4093d-3bea-4300-bba5-cfe4fe145e89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3958973-f8ca-4c63-b27b-72c3e272604e", "name": "network-vif-plugged", "status": "completed", "tag": "0b29defe-ef89-4b36-89eb-0cd5d2fb4aea"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:36:42.123472 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-c97706ee-bade-4de2-bdeb-7758729071c3 req-f6e4093d-3bea-4300-bba5-cfe4fe145e89 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:42.123916 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-c97706ee-bade-4de2-bdeb-7758729071c3 req-f6e4093d-3bea-4300-bba5-cfe4fe145e89 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:42.136012 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-c97706ee-bade-4de2-bdeb-7758729071c3 req-f6e4093d-3bea-4300-bba5-cfe4fe145e89 service nova] Creating event network-vif-plugged:0b29defe-ef89-4b36-89eb-0cd5d2fb4aea for instance a3958973-f8ca-4c63-b27b-72c3e272604e on hv-cinder-66710 Jun 01 04:36:42.142055 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-c97706ee-bade-4de2-bdeb-7758729071c3 req-f6e4093d-3bea-4300-bba5-cfe4fe145e89 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030644 Jun 01 04:36:42.142658 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 401/817] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:36:42.400177 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-c9b2d8db-1d50-4b0d-9279-7998132ec4b1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:42.400869 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-c9b2d8db-1d50-4b0d-9279-7998132ec4b1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:42.402826 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell0:SELECT=2 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:36:42.403587 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell0:SELECT=10 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:36:42.408966 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c9b2d8db-1d50-4b0d-9279-7998132ec4b1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:42.409415 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c9b2d8db-1d50-4b0d-9279-7998132ec4b1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:42.410181 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c9b2d8db-1d50-4b0d-9279-7998132ec4b1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:42.410607 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c9b2d8db-1d50-4b0d-9279-7998132ec4b1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:42.538650 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-c9b2d8db-1d50-4b0d-9279-7998132ec4b1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:42.546642 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-c9b2d8db-1d50-4b0d-9279-7998132ec4b1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:42.548186 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-c9b2d8db-1d50-4b0d-9279-7998132ec4b1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:42.549363 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-c9b2d8db-1d50-4b0d-9279-7998132ec4b1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1746 microversion: 2.20 time: 0.153067 Jun 01 04:36:42.549916 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 417/818] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:36:42 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:36:42.926916 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-e37f1605-3bf3-4618-843b-922a72dea9bb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:42.927765 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-e37f1605-3bf3-4618-843b-922a72dea9bb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:42.930371 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell0:SELECT=2 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:36:42.935584 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e37f1605-3bf3-4618-843b-922a72dea9bb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:42.936046 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e37f1605-3bf3-4618-843b-922a72dea9bb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:42.936866 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e37f1605-3bf3-4618-843b-922a72dea9bb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:42.937312 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e37f1605-3bf3-4618-843b-922a72dea9bb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:43.070379 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-e37f1605-3bf3-4618-843b-922a72dea9bb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:43.078377 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-e37f1605-3bf3-4618-843b-922a72dea9bb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4" status: 200 len: 1363 microversion: 2.1 time: 0.155698 Jun 01 04:36:43.078935 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 402/819] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:36:42 2022] GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:36:43.568154 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-896ab9a5-7eec-4e68-946b-a83048fce324 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:43.568767 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-896ab9a5-7eec-4e68-946b-a83048fce324 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:43.575788 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-896ab9a5-7eec-4e68-946b-a83048fce324 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:43.576253 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-896ab9a5-7eec-4e68-946b-a83048fce324 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:43.577035 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-896ab9a5-7eec-4e68-946b-a83048fce324 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:43.578071 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-896ab9a5-7eec-4e68-946b-a83048fce324 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:43.597121 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=100 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:36:43.715847 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-896ab9a5-7eec-4e68-946b-a83048fce324 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:43.724583 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-896ab9a5-7eec-4e68-946b-a83048fce324 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:43.726098 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-896ab9a5-7eec-4e68-946b-a83048fce324 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:43.727516 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-896ab9a5-7eec-4e68-946b-a83048fce324 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1746 microversion: 2.20 time: 0.163177 Jun 01 04:36:43.728068 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 418/820] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:36:43 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1746 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:36:44.096472 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-1acac3d1-41f3-48da-a855-be9a64cf9d82 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:44.097206 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-1acac3d1-41f3-48da-a855-be9a64cf9d82 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:44.104179 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1acac3d1-41f3-48da-a855-be9a64cf9d82 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:44.104628 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1acac3d1-41f3-48da-a855-be9a64cf9d82 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:44.105445 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1acac3d1-41f3-48da-a855-be9a64cf9d82 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:44.105880 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1acac3d1-41f3-48da-a855-be9a64cf9d82 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:44.257220 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-1acac3d1-41f3-48da-a855-be9a64cf9d82 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:44.266321 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-1acac3d1-41f3-48da-a855-be9a64cf9d82 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4" status: 200 len: 1363 microversion: 2.1 time: 0.174543 Jun 01 04:36:44.266910 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 403/821] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:36:44 2022] GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:36:44.457026 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-0793818d-e714-4ab0-87a5-f3cd3c7d9ba6 req-54391e36-89d0-4321-9749-b891a89252d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf719576-f4a4-4035-9a04-d219fcd92bc4", "name": "network-vif-plugged", "status": "completed", "tag": "4e9e2f71-edd1-4e77-8eea-aaca161637e1"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:36:44.465078 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-0793818d-e714-4ab0-87a5-f3cd3c7d9ba6 req-54391e36-89d0-4321-9749-b891a89252d8 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:44.465526 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-0793818d-e714-4ab0-87a5-f3cd3c7d9ba6 req-54391e36-89d0-4321-9749-b891a89252d8 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:44.477658 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-0793818d-e714-4ab0-87a5-f3cd3c7d9ba6 req-54391e36-89d0-4321-9749-b891a89252d8 service nova] Creating event network-vif-plugged:4e9e2f71-edd1-4e77-8eea-aaca161637e1 for instance bf719576-f4a4-4035-9a04-d219fcd92bc4 on hv-cinder-66710 Jun 01 04:36:44.482687 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-0793818d-e714-4ab0-87a5-f3cd3c7d9ba6 req-54391e36-89d0-4321-9749-b891a89252d8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029931 Jun 01 04:36:44.483370 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 419/822] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:36:44.746219 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-537bf412-37d0-4e62-b04f-1f146c448171 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:44.746714 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-537bf412-37d0-4e62-b04f-1f146c448171 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:44.753595 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-537bf412-37d0-4e62-b04f-1f146c448171 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:44.754355 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-537bf412-37d0-4e62-b04f-1f146c448171 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:44.755233 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-537bf412-37d0-4e62-b04f-1f146c448171 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:44.755700 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-537bf412-37d0-4e62-b04f-1f146c448171 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:44.905002 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-537bf412-37d0-4e62-b04f-1f146c448171 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:44.914423 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-537bf412-37d0-4e62-b04f-1f146c448171 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:44.915973 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-537bf412-37d0-4e62-b04f-1f146c448171 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:44.917139 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-537bf412-37d0-4e62-b04f-1f146c448171 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1746 microversion: 2.20 time: 0.174990 Jun 01 04:36:44.917694 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 404/823] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:36:44 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1746 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:36:45.289691 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-07ba0c24-9a07-478e-a0dc-c8927ac9921c tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:45.290452 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-07ba0c24-9a07-478e-a0dc-c8927ac9921c tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:45.300143 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-07ba0c24-9a07-478e-a0dc-c8927ac9921c tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:45.300666 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-07ba0c24-9a07-478e-a0dc-c8927ac9921c tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:45.301502 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-07ba0c24-9a07-478e-a0dc-c8927ac9921c tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:45.308861 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-07ba0c24-9a07-478e-a0dc-c8927ac9921c tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:45.487172 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-07ba0c24-9a07-478e-a0dc-c8927ac9921c tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:45.495196 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-07ba0c24-9a07-478e-a0dc-c8927ac9921c tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4" status: 200 len: 1363 microversion: 2.1 time: 0.210894 Jun 01 04:36:45.495869 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 420/824] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:36:45 2022] GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4 => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:36:45.935132 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-ebc1e930-9c22-4d4e-a9bf-c5bceb03d7b5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:45.935955 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-ebc1e930-9c22-4d4e-a9bf-c5bceb03d7b5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:45.943124 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ebc1e930-9c22-4d4e-a9bf-c5bceb03d7b5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:45.943619 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ebc1e930-9c22-4d4e-a9bf-c5bceb03d7b5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:45.944379 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ebc1e930-9c22-4d4e-a9bf-c5bceb03d7b5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:45.944816 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ebc1e930-9c22-4d4e-a9bf-c5bceb03d7b5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:46.094678 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-ebc1e930-9c22-4d4e-a9bf-c5bceb03d7b5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:46.103211 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-ebc1e930-9c22-4d4e-a9bf-c5bceb03d7b5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:46.104776 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-ebc1e930-9c22-4d4e-a9bf-c5bceb03d7b5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:46.105961 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-ebc1e930-9c22-4d4e-a9bf-c5bceb03d7b5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1746 microversion: 2.20 time: 0.174724 Jun 01 04:36:46.106513 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 405/825] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:36:45 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1746 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:36:46.513791 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-ed80e223-0ad7-4972-9745-634264e75ca0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:46.514390 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-ed80e223-0ad7-4972-9745-634264e75ca0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:46.522504 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ed80e223-0ad7-4972-9745-634264e75ca0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:46.522960 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ed80e223-0ad7-4972-9745-634264e75ca0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:46.523773 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ed80e223-0ad7-4972-9745-634264e75ca0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:46.524216 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ed80e223-0ad7-4972-9745-634264e75ca0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:46.688968 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-ed80e223-0ad7-4972-9745-634264e75ca0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:46.696485 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-ed80e223-0ad7-4972-9745-634264e75ca0 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4" status: 200 len: 1363 microversion: 2.1 time: 0.187254 Jun 01 04:36:46.697053 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 421/826] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:36:46 2022] GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:36:47.128721 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a7190ef0-4368-4856-b7e8-931b66ee9d56 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:47.129372 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-a7190ef0-4368-4856-b7e8-931b66ee9d56 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:47.135921 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a7190ef0-4368-4856-b7e8-931b66ee9d56 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:47.136374 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a7190ef0-4368-4856-b7e8-931b66ee9d56 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:47.137151 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a7190ef0-4368-4856-b7e8-931b66ee9d56 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:47.137590 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a7190ef0-4368-4856-b7e8-931b66ee9d56 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:47.293699 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-a7190ef0-4368-4856-b7e8-931b66ee9d56 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:47.315062 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-a7190ef0-4368-4856-b7e8-931b66ee9d56 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:47.317061 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-a7190ef0-4368-4856-b7e8-931b66ee9d56 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:47.318265 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-a7190ef0-4368-4856-b7e8-931b66ee9d56 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1741 microversion: 2.20 time: 0.194160 Jun 01 04:36:47.318999 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 406/827] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:36:47 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1741 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:36:47.714076 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-7bb31425-7cb3-43c2-8730-a67915ec10fc tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:47.714630 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-7bb31425-7cb3-43c2-8730-a67915ec10fc tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:47.723015 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7bb31425-7cb3-43c2-8730-a67915ec10fc tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:47.723015 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7bb31425-7cb3-43c2-8730-a67915ec10fc tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:47.723015 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7bb31425-7cb3-43c2-8730-a67915ec10fc tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:47.723015 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7bb31425-7cb3-43c2-8730-a67915ec10fc tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:47.872940 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-7bb31425-7cb3-43c2-8730-a67915ec10fc tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:47.880842 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-7bb31425-7cb3-43c2-8730-a67915ec10fc tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4" status: 200 len: 1549 microversion: 2.1 time: 0.170672 Jun 01 04:36:47.881470 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 422/828] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:36:47 2022] GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4 => generated 1549 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:36:47.901795 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-4eadf385-29e6-4b23-95b3-06c5c43c5bfe tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:47.902364 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-4eadf385-29e6-4b23-95b3-06c5c43c5bfe tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:47.909407 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4eadf385-29e6-4b23-95b3-06c5c43c5bfe tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:47.910053 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4eadf385-29e6-4b23-95b3-06c5c43c5bfe tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:47.910893 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4eadf385-29e6-4b23-95b3-06c5c43c5bfe tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:47.911480 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4eadf385-29e6-4b23-95b3-06c5c43c5bfe tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:48.005345 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-4eadf385-29e6-4b23-95b3-06c5c43c5bfe tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107666 Jun 01 04:36:48.006629 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 407/829] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Jun 1 04:36:47 2022] GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:36:48.337394 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b805811f-bc2c-4146-9d51-ed372d5da847 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:48.338335 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-b805811f-bc2c-4146-9d51-ed372d5da847 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:48.346927 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b805811f-bc2c-4146-9d51-ed372d5da847 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:48.350259 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b805811f-bc2c-4146-9d51-ed372d5da847 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:48.351281 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b805811f-bc2c-4146-9d51-ed372d5da847 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:48.351919 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b805811f-bc2c-4146-9d51-ed372d5da847 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:48.707106 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b805811f-bc2c-4146-9d51-ed372d5da847 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:48.717449 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b805811f-bc2c-4146-9d51-ed372d5da847 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:48.720348 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b805811f-bc2c-4146-9d51-ed372d5da847 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:48.721774 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-b805811f-bc2c-4146-9d51-ed372d5da847 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1741 microversion: 2.20 time: 0.388318 Jun 01 04:36:48.733201 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 423/830] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:36:48 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1741 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:36:49.514278 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-7622450e-6098-4be6-ad21-527d0526cf0b req-e2123964-15df-4fed-a144-22fa738250dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf719576-f4a4-4035-9a04-d219fcd92bc4", "tag": "4e9e2f71-edd1-4e77-8eea-aaca161637e1"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:36:49.528855 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-7622450e-6098-4be6-ad21-527d0526cf0b req-e2123964-15df-4fed-a144-22fa738250dc service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:49.529304 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-7622450e-6098-4be6-ad21-527d0526cf0b req-e2123964-15df-4fed-a144-22fa738250dc service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:49.542524 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-7622450e-6098-4be6-ad21-527d0526cf0b req-e2123964-15df-4fed-a144-22fa738250dc service nova] Creating event network-changed:4e9e2f71-edd1-4e77-8eea-aaca161637e1 for instance bf719576-f4a4-4035-9a04-d219fcd92bc4 on hv-cinder-66710 Jun 01 04:36:49.549340 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-7622450e-6098-4be6-ad21-527d0526cf0b req-e2123964-15df-4fed-a144-22fa738250dc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042212 Jun 01 04:36:49.551899 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 408/831] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:36:49.740659 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-f9f070f2-9ffe-476c-88d4-7a2df23c8034 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:49.741531 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-f9f070f2-9ffe-476c-88d4-7a2df23c8034 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:49.750747 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f9f070f2-9ffe-476c-88d4-7a2df23c8034 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:49.757994 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f9f070f2-9ffe-476c-88d4-7a2df23c8034 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:49.762907 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f9f070f2-9ffe-476c-88d4-7a2df23c8034 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:49.764470 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f9f070f2-9ffe-476c-88d4-7a2df23c8034 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:50.091745 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-f9f070f2-9ffe-476c-88d4-7a2df23c8034 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:50.102870 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-f9f070f2-9ffe-476c-88d4-7a2df23c8034 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:50.111839 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-f9f070f2-9ffe-476c-88d4-7a2df23c8034 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:50.115429 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-f9f070f2-9ffe-476c-88d4-7a2df23c8034 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1741 microversion: 2.20 time: 0.378523 Jun 01 04:36:50.116560 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 424/832] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:36:49 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1741 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:36:51.134932 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-31630447-5a52-4cd1-bde7-2cae4821836c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:51.135912 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-31630447-5a52-4cd1-bde7-2cae4821836c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:51.142445 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-31630447-5a52-4cd1-bde7-2cae4821836c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:51.143250 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-31630447-5a52-4cd1-bde7-2cae4821836c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:51.144091 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-31630447-5a52-4cd1-bde7-2cae4821836c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:51.144572 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-31630447-5a52-4cd1-bde7-2cae4821836c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:51.299792 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-31630447-5a52-4cd1-bde7-2cae4821836c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:51.312067 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-31630447-5a52-4cd1-bde7-2cae4821836c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:51.314444 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-31630447-5a52-4cd1-bde7-2cae4821836c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:51.316083 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-31630447-5a52-4cd1-bde7-2cae4821836c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1741 microversion: 2.20 time: 0.185817 Jun 01 04:36:51.323483 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 409/833] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:36:51 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1741 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:36:52.335133 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-802d72bf-14a6-4775-a62f-294155afc505 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:52.336338 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-802d72bf-14a6-4775-a62f-294155afc505 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:52.344994 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-802d72bf-14a6-4775-a62f-294155afc505 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:52.345740 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-802d72bf-14a6-4775-a62f-294155afc505 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:52.347101 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-802d72bf-14a6-4775-a62f-294155afc505 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:52.348055 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-802d72bf-14a6-4775-a62f-294155afc505 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:52.536681 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-802d72bf-14a6-4775-a62f-294155afc505 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:52.547609 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-802d72bf-14a6-4775-a62f-294155afc505 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:52.549592 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-802d72bf-14a6-4775-a62f-294155afc505 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:52.550955 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-802d72bf-14a6-4775-a62f-294155afc505 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1741 microversion: 2.20 time: 0.220025 Jun 01 04:36:52.552156 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 425/834] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:36:52 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1741 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:36:53.570454 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-054d4b2e-5ca2-4a52-a91f-1bc87cc85db5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:53.571077 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-054d4b2e-5ca2-4a52-a91f-1bc87cc85db5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:53.574806 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:36:53.578381 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-054d4b2e-5ca2-4a52-a91f-1bc87cc85db5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:53.578834 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-054d4b2e-5ca2-4a52-a91f-1bc87cc85db5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:53.579628 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-054d4b2e-5ca2-4a52-a91f-1bc87cc85db5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:53.580358 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-054d4b2e-5ca2-4a52-a91f-1bc87cc85db5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:53.735503 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-054d4b2e-5ca2-4a52-a91f-1bc87cc85db5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:53.747142 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-054d4b2e-5ca2-4a52-a91f-1bc87cc85db5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:53.748681 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-054d4b2e-5ca2-4a52-a91f-1bc87cc85db5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:53.750548 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-054d4b2e-5ca2-4a52-a91f-1bc87cc85db5 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1741 microversion: 2.20 time: 0.184216 Jun 01 04:36:53.751089 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 410/835] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:36:53 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1741 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:36:54.768653 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-fc5cc8bc-20ed-4d7d-bf6e-b84cb87d626d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:54.769240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-fc5cc8bc-20ed-4d7d-bf6e-b84cb87d626d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:54.771726 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:36:54.777433 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fc5cc8bc-20ed-4d7d-bf6e-b84cb87d626d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:54.778457 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fc5cc8bc-20ed-4d7d-bf6e-b84cb87d626d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:54.779233 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fc5cc8bc-20ed-4d7d-bf6e-b84cb87d626d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:54.779694 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fc5cc8bc-20ed-4d7d-bf6e-b84cb87d626d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:54.940750 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-fc5cc8bc-20ed-4d7d-bf6e-b84cb87d626d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:54.950135 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-fc5cc8bc-20ed-4d7d-bf6e-b84cb87d626d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:54.951676 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-fc5cc8bc-20ed-4d7d-bf6e-b84cb87d626d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:54.953599 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-fc5cc8bc-20ed-4d7d-bf6e-b84cb87d626d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1741 microversion: 2.20 time: 0.189495 Jun 01 04:36:54.954422 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 426/836] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:36:54 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1741 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:36:55.972990 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-d93c384a-f55e-423f-8534-dee9b7d30d01 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:55.974312 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-d93c384a-f55e-423f-8534-dee9b7d30d01 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:55.981428 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d93c384a-f55e-423f-8534-dee9b7d30d01 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:55.982219 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d93c384a-f55e-423f-8534-dee9b7d30d01 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:55.983264 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d93c384a-f55e-423f-8534-dee9b7d30d01 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:55.984067 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d93c384a-f55e-423f-8534-dee9b7d30d01 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:56.143031 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-d93c384a-f55e-423f-8534-dee9b7d30d01 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:56.152946 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-d93c384a-f55e-423f-8534-dee9b7d30d01 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:56.156114 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-d93c384a-f55e-423f-8534-dee9b7d30d01 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:56.156297 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-d93c384a-f55e-423f-8534-dee9b7d30d01 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1741 microversion: 2.20 time: 0.187853 Jun 01 04:36:56.157618 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 411/837] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:36:55 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1741 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:36:57.174509 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d314bf5b-90ff-4f2c-8672-fc4c0aa0a034 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:57.175969 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-d314bf5b-90ff-4f2c-8672-fc4c0aa0a034 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:57.183219 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d314bf5b-90ff-4f2c-8672-fc4c0aa0a034 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:57.183769 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d314bf5b-90ff-4f2c-8672-fc4c0aa0a034 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:57.184603 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d314bf5b-90ff-4f2c-8672-fc4c0aa0a034 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:57.185044 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d314bf5b-90ff-4f2c-8672-fc4c0aa0a034 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:57.342059 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-d314bf5b-90ff-4f2c-8672-fc4c0aa0a034 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:57.354900 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-d314bf5b-90ff-4f2c-8672-fc4c0aa0a034 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:57.356534 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-d314bf5b-90ff-4f2c-8672-fc4c0aa0a034 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:57.358002 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-d314bf5b-90ff-4f2c-8672-fc4c0aa0a034 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1741 microversion: 2.20 time: 0.187937 Jun 01 04:36:57.370035 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 427/838] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:36:57 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1741 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:36:58.378846 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-d5a24ec3-6e62-43d5-a90c-3b44c12241c1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:58.379575 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-d5a24ec3-6e62-43d5-a90c-3b44c12241c1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:58.386182 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d5a24ec3-6e62-43d5-a90c-3b44c12241c1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:58.386618 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d5a24ec3-6e62-43d5-a90c-3b44c12241c1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:58.387609 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d5a24ec3-6e62-43d5-a90c-3b44c12241c1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:58.387858 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d5a24ec3-6e62-43d5-a90c-3b44c12241c1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:58.530442 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-d5a24ec3-6e62-43d5-a90c-3b44c12241c1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:58.538815 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-d5a24ec3-6e62-43d5-a90c-3b44c12241c1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:58.540376 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-d5a24ec3-6e62-43d5-a90c-3b44c12241c1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:58.541589 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-d5a24ec3-6e62-43d5-a90c-3b44c12241c1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1741 microversion: 2.20 time: 0.167746 Jun 01 04:36:58.542233 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 412/839] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:36:58 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1741 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:36:59.560506 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b478e383-f62f-4f5e-8e4c-d4e75747932c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:36:59.561118 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-b478e383-f62f-4f5e-8e4c-d4e75747932c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:36:59.568048 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b478e383-f62f-4f5e-8e4c-d4e75747932c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:59.568518 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b478e383-f62f-4f5e-8e4c-d4e75747932c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:59.569369 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b478e383-f62f-4f5e-8e4c-d4e75747932c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:36:59.569822 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b478e383-f62f-4f5e-8e4c-d4e75747932c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:36:59.706152 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b478e383-f62f-4f5e-8e4c-d4e75747932c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:59.714268 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b478e383-f62f-4f5e-8e4c-d4e75747932c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:59.715827 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b478e383-f62f-4f5e-8e4c-d4e75747932c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:36:59.716983 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-b478e383-f62f-4f5e-8e4c-d4e75747932c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1741 microversion: 2.20 time: 0.160404 Jun 01 04:36:59.718216 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 428/840] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:36:59 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1741 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:37:00.736651 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-f5a65d81-8922-444a-b504-575666615d19 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:00.737339 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-f5a65d81-8922-444a-b504-575666615d19 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:00.743841 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f5a65d81-8922-444a-b504-575666615d19 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:00.744292 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f5a65d81-8922-444a-b504-575666615d19 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:00.745058 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f5a65d81-8922-444a-b504-575666615d19 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:00.745501 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f5a65d81-8922-444a-b504-575666615d19 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:00.878662 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-f5a65d81-8922-444a-b504-575666615d19 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:00.888972 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-f5a65d81-8922-444a-b504-575666615d19 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:00.890551 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-f5a65d81-8922-444a-b504-575666615d19 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:00.891743 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-f5a65d81-8922-444a-b504-575666615d19 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1741 microversion: 2.20 time: 0.159862 Jun 01 04:37:00.892345 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 413/841] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:37:00 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1741 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:37:01.909829 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b62a25b1-e8ba-449f-8b41-564c62521439 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:01.910547 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-b62a25b1-e8ba-449f-8b41-564c62521439 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:01.917252 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b62a25b1-e8ba-449f-8b41-564c62521439 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:01.917700 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b62a25b1-e8ba-449f-8b41-564c62521439 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:01.918485 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b62a25b1-e8ba-449f-8b41-564c62521439 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:01.918918 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b62a25b1-e8ba-449f-8b41-564c62521439 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:02.052646 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b62a25b1-e8ba-449f-8b41-564c62521439 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:02.060885 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b62a25b1-e8ba-449f-8b41-564c62521439 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:02.063244 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b62a25b1-e8ba-449f-8b41-564c62521439 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:02.064358 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-b62a25b1-e8ba-449f-8b41-564c62521439 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1723 microversion: 2.20 time: 0.158476 Jun 01 04:37:02.064912 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 429/842] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:37:01 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:37:03.084480 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-facc24ef-80d4-4395-90d7-6f7403f23e14 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:03.085096 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-facc24ef-80d4-4395-90d7-6f7403f23e14 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:03.091731 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-facc24ef-80d4-4395-90d7-6f7403f23e14 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:03.092182 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-facc24ef-80d4-4395-90d7-6f7403f23e14 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:03.092948 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-facc24ef-80d4-4395-90d7-6f7403f23e14 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:03.093388 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-facc24ef-80d4-4395-90d7-6f7403f23e14 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:03.222765 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-facc24ef-80d4-4395-90d7-6f7403f23e14 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:03.230776 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-facc24ef-80d4-4395-90d7-6f7403f23e14 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:03.232333 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-facc24ef-80d4-4395-90d7-6f7403f23e14 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:03.233488 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-facc24ef-80d4-4395-90d7-6f7403f23e14 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1723 microversion: 2.20 time: 0.153109 Jun 01 04:37:03.234836 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 414/843] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:37:03 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:37:04.252441 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-ccdc2389-bfa7-4924-9a5e-71129013c136 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:04.253058 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-ccdc2389-bfa7-4924-9a5e-71129013c136 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:04.259655 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ccdc2389-bfa7-4924-9a5e-71129013c136 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:04.260344 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ccdc2389-bfa7-4924-9a5e-71129013c136 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:04.260855 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ccdc2389-bfa7-4924-9a5e-71129013c136 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:04.261290 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ccdc2389-bfa7-4924-9a5e-71129013c136 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:04.403003 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-cabe1f13-e4af-4234-9ee9-4d23a954212f req-77194630-9121-47e1-99ac-011d863bd8bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3958973-f8ca-4c63-b27b-72c3e272604e", "name": "network-vif-unplugged", "status": "completed", "tag": "0b29defe-ef89-4b36-89eb-0cd5d2fb4aea"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:37:04.411102 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-ccdc2389-bfa7-4924-9a5e-71129013c136 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:04.414726 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-cabe1f13-e4af-4234-9ee9-4d23a954212f req-77194630-9121-47e1-99ac-011d863bd8bb service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:04.415241 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-cabe1f13-e4af-4234-9ee9-4d23a954212f req-77194630-9121-47e1-99ac-011d863bd8bb service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:04.419181 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-ccdc2389-bfa7-4924-9a5e-71129013c136 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:04.421206 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-ccdc2389-bfa7-4924-9a5e-71129013c136 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:04.423933 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-ccdc2389-bfa7-4924-9a5e-71129013c136 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1726 microversion: 2.20 time: 0.173836 Jun 01 04:37:04.423933 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 430/844] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:37:04 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1726 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:37:04.427627 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-cabe1f13-e4af-4234-9ee9-4d23a954212f req-77194630-9121-47e1-99ac-011d863bd8bb service nova] Creating event network-vif-unplugged:0b29defe-ef89-4b36-89eb-0cd5d2fb4aea for instance a3958973-f8ca-4c63-b27b-72c3e272604e on hv-cinder-66710 Jun 01 04:37:04.432902 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-cabe1f13-e4af-4234-9ee9-4d23a954212f req-77194630-9121-47e1-99ac-011d863bd8bb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034689 Jun 01 04:37:04.433482 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 415/845] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:37:04.439963 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-0c3eb296-2bbd-4905-8478-d39253ac07bd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84de5e55-0e2b-43f9-b3bb-1c43f9ef7de6"}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:37:04.441019 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-0c3eb296-2bbd-4905-8478-d39253ac07bd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:04.447010 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0c3eb296-2bbd-4905-8478-d39253ac07bd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:04.447499 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0c3eb296-2bbd-4905-8478-d39253ac07bd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:04.448252 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0c3eb296-2bbd-4905-8478-d39253ac07bd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:04.448682 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0c3eb296-2bbd-4905-8478-d39253ac07bd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:05.425111 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-0c3eb296-2bbd-4905-8478-d39253ac07bd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "POST /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.988897 Jun 01 04:37:05.425820 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 431/846] 10.222.0.18 () {62 vars in 1363 bytes} [Wed Jun 1 04:37:04 2022] POST /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e/os-volume_attachments => generated 188 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 01 04:37:05.549019 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-46dbee5c-1e35-4955-9351-80c9868c8458 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:05.549592 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-46dbee5c-1e35-4955-9351-80c9868c8458 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:05.555910 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-46dbee5c-1e35-4955-9351-80c9868c8458 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:05.556360 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-46dbee5c-1e35-4955-9351-80c9868c8458 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:05.557134 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-46dbee5c-1e35-4955-9351-80c9868c8458 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:05.557575 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-46dbee5c-1e35-4955-9351-80c9868c8458 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:05.652272 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:06.242777 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-46dbee5c-1e35-4955-9351-80c9868c8458 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e/os-volume_attachments/84de5e55-0e2b-43f9-b3bb-1c43f9ef7de6" status: 202 len: 0 microversion: 2.20 time: 0.699187 Jun 01 04:37:06.243321 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 416/847] 10.222.0.18 () {60 vars in 1456 bytes} [Wed Jun 1 04:37:05 2022] DELETE /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e/os-volume_attachments/84de5e55-0e2b-43f9-b3bb-1c43f9ef7de6 => generated 0 bytes in 701 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 01 04:37:06.298099 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-170886d9-2704-42d1-a69d-284327f955e0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:37:06.298664 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-170886d9-2704-42d1-a69d-284327f955e0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:06.304640 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-170886d9-2704-42d1-a69d-284327f955e0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:06.305087 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-170886d9-2704-42d1-a69d-284327f955e0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:06.305842 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-170886d9-2704-42d1-a69d-284327f955e0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:06.306274 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-170886d9-2704-42d1-a69d-284327f955e0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:06.366405 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:06.554282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-170886d9-2704-42d1-a69d-284327f955e0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "POST /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e/action" status: 202 len: 0 microversion: 2.20 time: 0.260091 Jun 01 04:37:06.554961 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 432/848] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Jun 1 04:37:06 2022] POST /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 01 04:37:06.562854 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-638702a1-b7c4-4979-9d32-48d192b46571 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:06.564111 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-638702a1-b7c4-4979-9d32-48d192b46571 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:06.570820 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-638702a1-b7c4-4979-9d32-48d192b46571 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:06.571269 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-638702a1-b7c4-4979-9d32-48d192b46571 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:06.572063 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-638702a1-b7c4-4979-9d32-48d192b46571 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:06.572496 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-638702a1-b7c4-4979-9d32-48d192b46571 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:06.710208 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-638702a1-b7c4-4979-9d32-48d192b46571 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:06.718031 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-638702a1-b7c4-4979-9d32-48d192b46571 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:06.720103 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-638702a1-b7c4-4979-9d32-48d192b46571 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:06.721253 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-638702a1-b7c4-4979-9d32-48d192b46571 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1674 microversion: 2.20 time: 0.162287 Jun 01 04:37:06.721801 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 417/849] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:37:06 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:37:07.739725 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-97b4a9ee-5922-4180-b4ce-6f45274bb19f tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:07.740330 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-97b4a9ee-5922-4180-b4ce-6f45274bb19f tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:07.747118 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-97b4a9ee-5922-4180-b4ce-6f45274bb19f tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:07.747590 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-97b4a9ee-5922-4180-b4ce-6f45274bb19f tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:07.748355 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-97b4a9ee-5922-4180-b4ce-6f45274bb19f tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:07.748900 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-97b4a9ee-5922-4180-b4ce-6f45274bb19f tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:07.878401 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-97b4a9ee-5922-4180-b4ce-6f45274bb19f tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:07.886708 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-97b4a9ee-5922-4180-b4ce-6f45274bb19f tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:07.888254 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-97b4a9ee-5922-4180-b4ce-6f45274bb19f tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:07.889410 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-97b4a9ee-5922-4180-b4ce-6f45274bb19f tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1674 microversion: 2.20 time: 0.154326 Jun 01 04:37:07.889962 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 433/850] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:37:07 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:37:08.720168 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-39536c22-196d-42b4-80f8-d38dfccc85b4 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:37:08.721170 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-39536c22-196d-42b4-80f8-d38dfccc85b4 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:08.727660 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-39536c22-196d-42b4-80f8-d38dfccc85b4 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:08.728115 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-39536c22-196d-42b4-80f8-d38dfccc85b4 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:08.728880 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-39536c22-196d-42b4-80f8-d38dfccc85b4 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:08.729410 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-39536c22-196d-42b4-80f8-d38dfccc85b4 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:08.907999 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-364f6a04-5e64-4de0-ab5e-dd48170fbc75 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:08.910066 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-364f6a04-5e64-4de0-ab5e-dd48170fbc75 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:08.916939 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-364f6a04-5e64-4de0-ab5e-dd48170fbc75 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:08.917894 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-364f6a04-5e64-4de0-ab5e-dd48170fbc75 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:08.918284 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-364f6a04-5e64-4de0-ab5e-dd48170fbc75 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:08.918732 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-364f6a04-5e64-4de0-ab5e-dd48170fbc75 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:08.947058 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-39536c22-196d-42b4-80f8-d38dfccc85b4 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "POST /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7/action" status: 202 len: 0 microversion: 2.1 time: 0.230639 Jun 01 04:37:08.951202 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 418/851] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 1 04:37:08 2022] POST /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 01 04:37:08.957362 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-eb63ba3f-1182-4659-9ba6-db7546032b42 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:08.958065 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-eb63ba3f-1182-4659-9ba6-db7546032b42 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:08.964505 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-eb63ba3f-1182-4659-9ba6-db7546032b42 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:08.965220 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-eb63ba3f-1182-4659-9ba6-db7546032b42 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:08.966158 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-eb63ba3f-1182-4659-9ba6-db7546032b42 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:08.966593 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-eb63ba3f-1182-4659-9ba6-db7546032b42 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:09.138354 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-364f6a04-5e64-4de0-ab5e-dd48170fbc75 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:09.146667 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-eb63ba3f-1182-4659-9ba6-db7546032b42 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:09.148121 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-364f6a04-5e64-4de0-ab5e-dd48170fbc75 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:09.149859 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-364f6a04-5e64-4de0-ab5e-dd48170fbc75 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:09.151284 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-364f6a04-5e64-4de0-ab5e-dd48170fbc75 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1732 microversion: 2.20 time: 0.247647 Jun 01 04:37:09.158725 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 434/852] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:37:08 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1732 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:37:09.163603 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-eb63ba3f-1182-4659-9ba6-db7546032b42 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1751 microversion: 2.1 time: 0.210634 Jun 01 04:37:09.164195 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 419/853] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:37:08 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1751 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:37:10.170882 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-12cdfb84-d007-44ac-87c1-0c03984c0bd2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:10.171546 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-12cdfb84-d007-44ac-87c1-0c03984c0bd2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:10.178985 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-12cdfb84-d007-44ac-87c1-0c03984c0bd2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:10.183732 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-12cdfb84-d007-44ac-87c1-0c03984c0bd2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:10.183732 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-12cdfb84-d007-44ac-87c1-0c03984c0bd2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:10.183732 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-12cdfb84-d007-44ac-87c1-0c03984c0bd2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:10.184025 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-e4cdba5a-afbd-46a0-800a-388567dd8f90 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:10.184025 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-e4cdba5a-afbd-46a0-800a-388567dd8f90 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:10.189874 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e4cdba5a-afbd-46a0-800a-388567dd8f90 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:10.190316 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e4cdba5a-afbd-46a0-800a-388567dd8f90 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:10.191085 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e4cdba5a-afbd-46a0-800a-388567dd8f90 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:10.191605 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e4cdba5a-afbd-46a0-800a-388567dd8f90 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:10.461173 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-12cdfb84-d007-44ac-87c1-0c03984c0bd2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:10.481951 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-12cdfb84-d007-44ac-87c1-0c03984c0bd2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:10.483781 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-12cdfb84-d007-44ac-87c1-0c03984c0bd2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:10.486057 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-12cdfb84-d007-44ac-87c1-0c03984c0bd2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1732 microversion: 2.20 time: 0.318154 Jun 01 04:37:10.486996 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 435/854] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:37:10 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1732 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:37:10.674882 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-e4cdba5a-afbd-46a0-800a-388567dd8f90 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:10.678351 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-e4cdba5a-afbd-46a0-800a-388567dd8f90 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1756 microversion: 2.1 time: 0.499983 Jun 01 04:37:10.679023 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 420/855] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:37:10 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1756 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:37:11.504624 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-781f2c5f-a383-4886-b578-334ebe718ec9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:11.505253 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-781f2c5f-a383-4886-b578-334ebe718ec9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:11.512030 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-781f2c5f-a383-4886-b578-334ebe718ec9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:11.512475 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-781f2c5f-a383-4886-b578-334ebe718ec9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:11.513241 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-781f2c5f-a383-4886-b578-334ebe718ec9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:11.513675 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-781f2c5f-a383-4886-b578-334ebe718ec9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:11.650885 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-781f2c5f-a383-4886-b578-334ebe718ec9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:11.659755 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-781f2c5f-a383-4886-b578-334ebe718ec9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:11.661262 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-781f2c5f-a383-4886-b578-334ebe718ec9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:11.662456 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-781f2c5f-a383-4886-b578-334ebe718ec9 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1732 microversion: 2.20 time: 0.162395 Jun 01 04:37:11.663258 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 436/856] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:37:11 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:37:11.697335 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-e3044524-ce30-46dc-b61f-17029313d316 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:11.698154 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-e3044524-ce30-46dc-b61f-17029313d316 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:11.705229 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e3044524-ce30-46dc-b61f-17029313d316 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:11.705684 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e3044524-ce30-46dc-b61f-17029313d316 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:11.706468 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e3044524-ce30-46dc-b61f-17029313d316 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:11.706909 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e3044524-ce30-46dc-b61f-17029313d316 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:11.858175 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-e3044524-ce30-46dc-b61f-17029313d316 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:11.868262 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-e3044524-ce30-46dc-b61f-17029313d316 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1756 microversion: 2.1 time: 0.174789 Jun 01 04:37:11.868808 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 421/857] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:37:11 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:37:12.680951 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-7fc1276c-a37b-4f63-8f04-2f59a48168ed tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:12.681595 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-7fc1276c-a37b-4f63-8f04-2f59a48168ed tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:12.688546 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7fc1276c-a37b-4f63-8f04-2f59a48168ed tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:12.689026 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7fc1276c-a37b-4f63-8f04-2f59a48168ed tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:12.689823 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7fc1276c-a37b-4f63-8f04-2f59a48168ed tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:12.690264 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7fc1276c-a37b-4f63-8f04-2f59a48168ed tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:12.839618 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-7fc1276c-a37b-4f63-8f04-2f59a48168ed tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:12.847973 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-7fc1276c-a37b-4f63-8f04-2f59a48168ed tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:12.849612 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-7fc1276c-a37b-4f63-8f04-2f59a48168ed tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:12.850867 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-7fc1276c-a37b-4f63-8f04-2f59a48168ed tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1732 microversion: 2.20 time: 0.173959 Jun 01 04:37:12.851540 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 437/858] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:37:12 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:37:12.886505 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-ea1072bf-ea7a-4601-9a62-2dd76e619738 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:12.887169 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-ea1072bf-ea7a-4601-9a62-2dd76e619738 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:12.894515 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ea1072bf-ea7a-4601-9a62-2dd76e619738 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:12.895032 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ea1072bf-ea7a-4601-9a62-2dd76e619738 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:12.895794 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ea1072bf-ea7a-4601-9a62-2dd76e619738 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:12.896244 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ea1072bf-ea7a-4601-9a62-2dd76e619738 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:13.049432 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-ea1072bf-ea7a-4601-9a62-2dd76e619738 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:13.058229 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-ea1072bf-ea7a-4601-9a62-2dd76e619738 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1756 microversion: 2.1 time: 0.175549 Jun 01 04:37:13.059496 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 422/859] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:37:12 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:37:13.869347 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-baf297b4-c759-44cd-a246-c199c985bf53 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:13.870203 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-baf297b4-c759-44cd-a246-c199c985bf53 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:13.878319 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-baf297b4-c759-44cd-a246-c199c985bf53 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:13.878697 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-baf297b4-c759-44cd-a246-c199c985bf53 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:13.879533 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-baf297b4-c759-44cd-a246-c199c985bf53 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:13.880030 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-baf297b4-c759-44cd-a246-c199c985bf53 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:14.025654 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-baf297b4-c759-44cd-a246-c199c985bf53 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:14.034645 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-baf297b4-c759-44cd-a246-c199c985bf53 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:14.036496 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-baf297b4-c759-44cd-a246-c199c985bf53 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:14.037731 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-baf297b4-c759-44cd-a246-c199c985bf53 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1732 microversion: 2.20 time: 0.172410 Jun 01 04:37:14.038367 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 438/860] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:37:13 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:37:14.076799 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-7d37b17b-e6d4-4366-a2f3-d3bbb09a9b5a tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:14.077493 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-7d37b17b-e6d4-4366-a2f3-d3bbb09a9b5a tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:14.084807 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7d37b17b-e6d4-4366-a2f3-d3bbb09a9b5a tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:14.085341 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7d37b17b-e6d4-4366-a2f3-d3bbb09a9b5a tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:14.086200 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7d37b17b-e6d4-4366-a2f3-d3bbb09a9b5a tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:14.086703 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7d37b17b-e6d4-4366-a2f3-d3bbb09a9b5a tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:14.244173 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-7d37b17b-e6d4-4366-a2f3-d3bbb09a9b5a tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:14.253319 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-7d37b17b-e6d4-4366-a2f3-d3bbb09a9b5a tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1756 microversion: 2.1 time: 0.180246 Jun 01 04:37:14.253941 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 423/861] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:37:14 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:37:15.057581 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-c2f64354-fe11-4957-af7d-4e3298400652 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:15.058220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-c2f64354-fe11-4957-af7d-4e3298400652 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:15.065762 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c2f64354-fe11-4957-af7d-4e3298400652 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:15.066218 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c2f64354-fe11-4957-af7d-4e3298400652 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:15.067001 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c2f64354-fe11-4957-af7d-4e3298400652 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:15.067473 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c2f64354-fe11-4957-af7d-4e3298400652 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:15.226634 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-c2f64354-fe11-4957-af7d-4e3298400652 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:15.237242 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-c2f64354-fe11-4957-af7d-4e3298400652 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:15.238876 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-c2f64354-fe11-4957-af7d-4e3298400652 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:15.240142 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-c2f64354-fe11-4957-af7d-4e3298400652 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1732 microversion: 2.20 time: 0.188192 Jun 01 04:37:15.240690 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 439/862] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:37:15 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1732 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:37:15.274907 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-8f9660be-cd0d-4ac2-b91b-0d380deb1831 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:15.275664 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-8f9660be-cd0d-4ac2-b91b-0d380deb1831 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:15.285578 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8f9660be-cd0d-4ac2-b91b-0d380deb1831 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:15.286019 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8f9660be-cd0d-4ac2-b91b-0d380deb1831 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:15.286793 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8f9660be-cd0d-4ac2-b91b-0d380deb1831 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:15.287223 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8f9660be-cd0d-4ac2-b91b-0d380deb1831 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:15.461052 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-8f9660be-cd0d-4ac2-b91b-0d380deb1831 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:15.470268 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-8f9660be-cd0d-4ac2-b91b-0d380deb1831 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1756 microversion: 2.1 time: 0.201074 Jun 01 04:37:15.471524 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 424/863] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:37:15 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1756 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:37:16.259645 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-5337e7cd-a75d-4266-bcab-86d0cda6f118 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:16.260380 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-5337e7cd-a75d-4266-bcab-86d0cda6f118 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:16.269958 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5337e7cd-a75d-4266-bcab-86d0cda6f118 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:16.270559 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5337e7cd-a75d-4266-bcab-86d0cda6f118 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:16.271434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5337e7cd-a75d-4266-bcab-86d0cda6f118 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:16.271936 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5337e7cd-a75d-4266-bcab-86d0cda6f118 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:16.416626 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-5337e7cd-a75d-4266-bcab-86d0cda6f118 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:16.427425 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-5337e7cd-a75d-4266-bcab-86d0cda6f118 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:16.428960 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-5337e7cd-a75d-4266-bcab-86d0cda6f118 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:16.430144 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-5337e7cd-a75d-4266-bcab-86d0cda6f118 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1732 microversion: 2.20 time: 0.175194 Jun 01 04:37:16.430739 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 440/864] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:37:16 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:37:16.488608 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-8222590d-6554-45af-91b5-6f505a443f9c tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:16.489316 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-8222590d-6554-45af-91b5-6f505a443f9c tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:16.495921 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8222590d-6554-45af-91b5-6f505a443f9c tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:16.496377 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8222590d-6554-45af-91b5-6f505a443f9c tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:16.497153 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8222590d-6554-45af-91b5-6f505a443f9c tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:16.497598 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8222590d-6554-45af-91b5-6f505a443f9c tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:16.655707 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-8222590d-6554-45af-91b5-6f505a443f9c tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:16.664390 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-8222590d-6554-45af-91b5-6f505a443f9c tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1756 microversion: 2.1 time: 0.180156 Jun 01 04:37:16.665314 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 425/865] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:37:16 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:37:17.451265 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-8866fd71-ca2f-4512-a8b6-87eaf16bdbaf tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:17.451954 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-8866fd71-ca2f-4512-a8b6-87eaf16bdbaf tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:17.459131 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8866fd71-ca2f-4512-a8b6-87eaf16bdbaf tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:17.459818 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8866fd71-ca2f-4512-a8b6-87eaf16bdbaf tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:17.460424 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8866fd71-ca2f-4512-a8b6-87eaf16bdbaf tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:17.460862 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8866fd71-ca2f-4512-a8b6-87eaf16bdbaf tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:17.605803 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-8866fd71-ca2f-4512-a8b6-87eaf16bdbaf tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:17.615318 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-8866fd71-ca2f-4512-a8b6-87eaf16bdbaf tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:17.617180 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-8866fd71-ca2f-4512-a8b6-87eaf16bdbaf tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:17.618381 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-8866fd71-ca2f-4512-a8b6-87eaf16bdbaf tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1732 microversion: 2.20 time: 0.171032 Jun 01 04:37:17.619237 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 441/866] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:37:17 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:37:17.682347 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-69d2096e-360b-41fb-a8e0-86bcb7a98bb2 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:17.687947 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-69d2096e-360b-41fb-a8e0-86bcb7a98bb2 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:17.690669 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-69d2096e-360b-41fb-a8e0-86bcb7a98bb2 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:17.691199 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-69d2096e-360b-41fb-a8e0-86bcb7a98bb2 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:17.692082 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-69d2096e-360b-41fb-a8e0-86bcb7a98bb2 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:17.692861 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-69d2096e-360b-41fb-a8e0-86bcb7a98bb2 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:17.860078 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-69d2096e-360b-41fb-a8e0-86bcb7a98bb2 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:17.869277 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-69d2096e-360b-41fb-a8e0-86bcb7a98bb2 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1756 microversion: 2.1 time: 0.190690 Jun 01 04:37:17.869860 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 426/867] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:37:17 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:37:18.639557 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-baadf38b-ab5e-438c-b0e1-f601a85e264c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:18.640824 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-baadf38b-ab5e-438c-b0e1-f601a85e264c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:18.652301 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-baadf38b-ab5e-438c-b0e1-f601a85e264c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:18.652755 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-baadf38b-ab5e-438c-b0e1-f601a85e264c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:18.653581 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-baadf38b-ab5e-438c-b0e1-f601a85e264c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:18.654027 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-baadf38b-ab5e-438c-b0e1-f601a85e264c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:18.829464 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-baadf38b-ab5e-438c-b0e1-f601a85e264c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:18.839329 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-baadf38b-ab5e-438c-b0e1-f601a85e264c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:18.840866 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-baadf38b-ab5e-438c-b0e1-f601a85e264c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:18.842813 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-baadf38b-ab5e-438c-b0e1-f601a85e264c tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1732 microversion: 2.20 time: 0.207264 Jun 01 04:37:18.842813 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 442/868] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:37:18 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1732 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:37:18.895774 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-9f75fca6-f6da-4066-8d8e-ca45cdf3c464 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:18.896517 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-9f75fca6-f6da-4066-8d8e-ca45cdf3c464 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:18.903971 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9f75fca6-f6da-4066-8d8e-ca45cdf3c464 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:18.904821 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9f75fca6-f6da-4066-8d8e-ca45cdf3c464 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:18.905630 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9f75fca6-f6da-4066-8d8e-ca45cdf3c464 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:18.906068 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9f75fca6-f6da-4066-8d8e-ca45cdf3c464 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:19.077357 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-9f75fca6-f6da-4066-8d8e-ca45cdf3c464 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:19.086777 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-9f75fca6-f6da-4066-8d8e-ca45cdf3c464 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1756 microversion: 2.1 time: 0.197781 Jun 01 04:37:19.087404 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 427/869] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:37:18 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1756 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:37:19.861745 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-1b09a3dc-23a0-452e-b395-5125b301413d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:19.862448 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-1b09a3dc-23a0-452e-b395-5125b301413d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:19.868904 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1b09a3dc-23a0-452e-b395-5125b301413d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:19.871075 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1b09a3dc-23a0-452e-b395-5125b301413d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:19.871075 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1b09a3dc-23a0-452e-b395-5125b301413d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:19.871075 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1b09a3dc-23a0-452e-b395-5125b301413d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:20.001616 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-1b09a3dc-23a0-452e-b395-5125b301413d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:20.010627 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-1b09a3dc-23a0-452e-b395-5125b301413d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:20.012205 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-1b09a3dc-23a0-452e-b395-5125b301413d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:20.013367 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-1b09a3dc-23a0-452e-b395-5125b301413d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1732 microversion: 2.20 time: 0.156293 Jun 01 04:37:20.013922 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 443/870] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:37:19 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:37:20.104830 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-7915641c-b3a7-4baf-ab8c-5a5dbf116c30 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:20.105894 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-7915641c-b3a7-4baf-ab8c-5a5dbf116c30 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:20.112837 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7915641c-b3a7-4baf-ab8c-5a5dbf116c30 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:20.113278 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7915641c-b3a7-4baf-ab8c-5a5dbf116c30 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:20.114040 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7915641c-b3a7-4baf-ab8c-5a5dbf116c30 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:20.114475 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7915641c-b3a7-4baf-ab8c-5a5dbf116c30 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:20.258483 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-7915641c-b3a7-4baf-ab8c-5a5dbf116c30 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:20.266544 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-7915641c-b3a7-4baf-ab8c-5a5dbf116c30 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1756 microversion: 2.1 time: 0.165527 Jun 01 04:37:20.272272 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 428/871] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:37:20 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:37:21.031135 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-ae049bbb-d388-4368-b63d-30b917a5a5f2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:21.031857 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-ae049bbb-d388-4368-b63d-30b917a5a5f2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:21.038810 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ae049bbb-d388-4368-b63d-30b917a5a5f2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:21.039269 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ae049bbb-d388-4368-b63d-30b917a5a5f2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:21.040083 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ae049bbb-d388-4368-b63d-30b917a5a5f2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:21.040526 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ae049bbb-d388-4368-b63d-30b917a5a5f2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:21.067169 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 01 04:37:21.067485 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Wed Jun 1 04:37:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 01 04:37:21.174967 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-ae049bbb-d388-4368-b63d-30b917a5a5f2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:21.182985 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-ae049bbb-d388-4368-b63d-30b917a5a5f2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:21.184524 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-ae049bbb-d388-4368-b63d-30b917a5a5f2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:21.185677 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-ae049bbb-d388-4368-b63d-30b917a5a5f2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1732 microversion: 2.20 time: 0.158480 Jun 01 04:37:21.186241 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 444/872] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:37:21 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:37:21.284728 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-7dda20da-7bee-4cdb-a284-c223945e58b9 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:21.285274 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-7dda20da-7bee-4cdb-a284-c223945e58b9 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:21.291842 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7dda20da-7bee-4cdb-a284-c223945e58b9 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:21.292298 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7dda20da-7bee-4cdb-a284-c223945e58b9 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:21.293070 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7dda20da-7bee-4cdb-a284-c223945e58b9 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:21.293507 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7dda20da-7bee-4cdb-a284-c223945e58b9 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:21.435877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-7dda20da-7bee-4cdb-a284-c223945e58b9 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:21.444009 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-7dda20da-7bee-4cdb-a284-c223945e58b9 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1756 microversion: 2.1 time: 0.163979 Jun 01 04:37:21.444571 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 429/873] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:37:21 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:37:22.204598 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-e9797953-3c1e-4cb4-a424-e6a6a80d8cad tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:22.205676 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-e9797953-3c1e-4cb4-a424-e6a6a80d8cad tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:22.212159 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e9797953-3c1e-4cb4-a424-e6a6a80d8cad tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:22.212612 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e9797953-3c1e-4cb4-a424-e6a6a80d8cad tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:22.213374 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e9797953-3c1e-4cb4-a424-e6a6a80d8cad tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:22.213813 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e9797953-3c1e-4cb4-a424-e6a6a80d8cad tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:22.343460 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-e9797953-3c1e-4cb4-a424-e6a6a80d8cad tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:22.351835 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-e9797953-3c1e-4cb4-a424-e6a6a80d8cad tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:22.353350 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-e9797953-3c1e-4cb4-a424-e6a6a80d8cad tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:22.354537 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-e9797953-3c1e-4cb4-a424-e6a6a80d8cad tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1732 microversion: 2.20 time: 0.153944 Jun 01 04:37:22.355095 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 445/874] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:37:22 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:37:22.461154 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-1d015ab3-9c2a-4a58-9d43-4428ee762fbb tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:22.461686 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-1d015ab3-9c2a-4a58-9d43-4428ee762fbb tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:22.468680 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1d015ab3-9c2a-4a58-9d43-4428ee762fbb tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:22.469499 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1d015ab3-9c2a-4a58-9d43-4428ee762fbb tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:22.470925 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1d015ab3-9c2a-4a58-9d43-4428ee762fbb tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:22.471458 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1d015ab3-9c2a-4a58-9d43-4428ee762fbb tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:22.616104 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-1d015ab3-9c2a-4a58-9d43-4428ee762fbb tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:22.618425 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:22.625370 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-1d015ab3-9c2a-4a58-9d43-4428ee762fbb tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1756 microversion: 2.1 time: 0.167830 Jun 01 04:37:22.625692 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 430/875] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:37:22 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:37:23.373327 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-3d11bbb5-fe68-494c-b3ef-310779b76bee tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:23.373921 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-3d11bbb5-fe68-494c-b3ef-310779b76bee tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:23.380871 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3d11bbb5-fe68-494c-b3ef-310779b76bee tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:23.381322 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3d11bbb5-fe68-494c-b3ef-310779b76bee tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:23.382113 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3d11bbb5-fe68-494c-b3ef-310779b76bee tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:23.382546 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3d11bbb5-fe68-494c-b3ef-310779b76bee tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:23.513568 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-3d11bbb5-fe68-494c-b3ef-310779b76bee tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:23.521654 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-3d11bbb5-fe68-494c-b3ef-310779b76bee tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:23.523176 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-3d11bbb5-fe68-494c-b3ef-310779b76bee tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:23.524363 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-3d11bbb5-fe68-494c-b3ef-310779b76bee tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1732 microversion: 2.20 time: 0.155117 Jun 01 04:37:23.524919 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 446/876] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:37:23 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:37:23.642149 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-05995990-82b5-4972-932c-1295b8fdd773 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:23.642761 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-05995990-82b5-4972-932c-1295b8fdd773 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:23.645728 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_api:SELECT=42 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:23.650753 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-05995990-82b5-4972-932c-1295b8fdd773 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:23.651198 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-05995990-82b5-4972-932c-1295b8fdd773 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:23.651988 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-05995990-82b5-4972-932c-1295b8fdd773 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:23.652426 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-05995990-82b5-4972-932c-1295b8fdd773 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:23.797345 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-05995990-82b5-4972-932c-1295b8fdd773 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:23.806194 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-05995990-82b5-4972-932c-1295b8fdd773 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1756 microversion: 2.1 time: 0.167865 Jun 01 04:37:23.807002 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 431/877] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:37:23 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:37:24.541963 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-135a2dad-184f-4d18-9876-1876e7892bf0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:24.542576 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-135a2dad-184f-4d18-9876-1876e7892bf0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:24.550012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-135a2dad-184f-4d18-9876-1876e7892bf0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:24.550473 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-135a2dad-184f-4d18-9876-1876e7892bf0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:24.551246 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-135a2dad-184f-4d18-9876-1876e7892bf0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:24.551798 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-135a2dad-184f-4d18-9876-1876e7892bf0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:24.690910 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-135a2dad-184f-4d18-9876-1876e7892bf0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:24.699200 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-135a2dad-184f-4d18-9876-1876e7892bf0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:24.700740 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-135a2dad-184f-4d18-9876-1876e7892bf0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:24.701894 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-135a2dad-184f-4d18-9876-1876e7892bf0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1732 microversion: 2.20 time: 0.163853 Jun 01 04:37:24.702457 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 447/878] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:37:24 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:37:24.823718 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-5b1d25ef-d51b-48fd-9963-b932e4ecc832 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:24.824260 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-5b1d25ef-d51b-48fd-9963-b932e4ecc832 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:24.830739 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5b1d25ef-d51b-48fd-9963-b932e4ecc832 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:24.831190 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5b1d25ef-d51b-48fd-9963-b932e4ecc832 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:24.832005 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5b1d25ef-d51b-48fd-9963-b932e4ecc832 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:24.832448 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5b1d25ef-d51b-48fd-9963-b932e4ecc832 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:24.973320 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-5b1d25ef-d51b-48fd-9963-b932e4ecc832 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:24.981194 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-5b1d25ef-d51b-48fd-9963-b932e4ecc832 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1756 microversion: 2.1 time: 0.161516 Jun 01 04:37:24.981748 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 432/879] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:37:24 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:37:25.721452 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-cde59ab7-35c8-48d2-9eea-d88a7a6404f2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:25.722007 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-cde59ab7-35c8-48d2-9eea-d88a7a6404f2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:25.724412 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_api:SELECT=46 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:25.729388 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cde59ab7-35c8-48d2-9eea-d88a7a6404f2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:25.732121 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cde59ab7-35c8-48d2-9eea-d88a7a6404f2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:25.732121 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cde59ab7-35c8-48d2-9eea-d88a7a6404f2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:25.732121 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cde59ab7-35c8-48d2-9eea-d88a7a6404f2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:25.862280 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-cde59ab7-35c8-48d2-9eea-d88a7a6404f2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:25.865774 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:25.870663 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-cde59ab7-35c8-48d2-9eea-d88a7a6404f2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:25.872260 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-cde59ab7-35c8-48d2-9eea-d88a7a6404f2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:25.875176 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-cde59ab7-35c8-48d2-9eea-d88a7a6404f2 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1732 microversion: 2.20 time: 0.156797 Jun 01 04:37:25.875176 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 448/880] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:37:25 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:37:25.997905 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-3b5ec75b-14fe-402c-9c6c-e1d5c3750058 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:25.998449 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-3b5ec75b-14fe-402c-9c6c-e1d5c3750058 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:26.005539 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3b5ec75b-14fe-402c-9c6c-e1d5c3750058 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:26.006017 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3b5ec75b-14fe-402c-9c6c-e1d5c3750058 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:26.006793 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3b5ec75b-14fe-402c-9c6c-e1d5c3750058 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:26.007236 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3b5ec75b-14fe-402c-9c6c-e1d5c3750058 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:26.156506 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-3b5ec75b-14fe-402c-9c6c-e1d5c3750058 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:26.164662 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-3b5ec75b-14fe-402c-9c6c-e1d5c3750058 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1759 microversion: 2.1 time: 0.170689 Jun 01 04:37:26.165240 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 433/881] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:37:25 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1759 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:37:26.892236 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-77a92ba2-8273-4c27-b161-d4fa13c21a1e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:26.892854 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-77a92ba2-8273-4c27-b161-d4fa13c21a1e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:26.900889 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-77a92ba2-8273-4c27-b161-d4fa13c21a1e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:26.901355 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-77a92ba2-8273-4c27-b161-d4fa13c21a1e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:26.902128 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-77a92ba2-8273-4c27-b161-d4fa13c21a1e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:26.902585 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-77a92ba2-8273-4c27-b161-d4fa13c21a1e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:27.033440 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-77a92ba2-8273-4c27-b161-d4fa13c21a1e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:27.041621 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-77a92ba2-8273-4c27-b161-d4fa13c21a1e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:27.043177 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-77a92ba2-8273-4c27-b161-d4fa13c21a1e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:27.044349 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-77a92ba2-8273-4c27-b161-d4fa13c21a1e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1732 microversion: 2.20 time: 0.156213 Jun 01 04:37:27.045050 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 449/882] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:37:26 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:37:28.063003 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-b857e0d4-c772-4eb8-9764-9e28b053056d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:28.063641 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-b857e0d4-c772-4eb8-9764-9e28b053056d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:28.071553 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b857e0d4-c772-4eb8-9764-9e28b053056d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:28.072016 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b857e0d4-c772-4eb8-9764-9e28b053056d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:28.073085 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b857e0d4-c772-4eb8-9764-9e28b053056d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:28.073522 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b857e0d4-c772-4eb8-9764-9e28b053056d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:28.208289 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-b857e0d4-c772-4eb8-9764-9e28b053056d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:28.217358 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-b857e0d4-c772-4eb8-9764-9e28b053056d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:28.219105 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-b857e0d4-c772-4eb8-9764-9e28b053056d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:28.220534 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-b857e0d4-c772-4eb8-9764-9e28b053056d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1732 microversion: 2.20 time: 0.161438 Jun 01 04:37:28.221188 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 434/883] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:37:28 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:37:28.571017 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-f8500c1d-bc4a-4ef3-94da-cc98b90f8e93 req-52a7163b-8e31-4f6a-bbe8-ba831b1f3c1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3958973-f8ca-4c63-b27b-72c3e272604e", "name": "network-vif-plugged", "status": "completed", "tag": "0b29defe-ef89-4b36-89eb-0cd5d2fb4aea"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:37:28.579879 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-f8500c1d-bc4a-4ef3-94da-cc98b90f8e93 req-52a7163b-8e31-4f6a-bbe8-ba831b1f3c1e service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:28.580332 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-f8500c1d-bc4a-4ef3-94da-cc98b90f8e93 req-52a7163b-8e31-4f6a-bbe8-ba831b1f3c1e service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:28.591838 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-f8500c1d-bc4a-4ef3-94da-cc98b90f8e93 req-52a7163b-8e31-4f6a-bbe8-ba831b1f3c1e service nova] Creating event network-vif-plugged:0b29defe-ef89-4b36-89eb-0cd5d2fb4aea for instance a3958973-f8ca-4c63-b27b-72c3e272604e on hv-cinder-66710 Jun 01 04:37:28.596980 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-f8500c1d-bc4a-4ef3-94da-cc98b90f8e93 req-52a7163b-8e31-4f6a-bbe8-ba831b1f3c1e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030269 Jun 01 04:37:28.597555 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 450/884] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:37:29.239465 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-820aecbe-495a-4a2c-a0c1-aa0f23c9a0f4 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:29.240064 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-820aecbe-495a-4a2c-a0c1-aa0f23c9a0f4 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:29.247068 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-820aecbe-495a-4a2c-a0c1-aa0f23c9a0f4 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:29.247569 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-820aecbe-495a-4a2c-a0c1-aa0f23c9a0f4 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:29.248342 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-820aecbe-495a-4a2c-a0c1-aa0f23c9a0f4 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:29.248836 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-820aecbe-495a-4a2c-a0c1-aa0f23c9a0f4 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:29.378356 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-820aecbe-495a-4a2c-a0c1-aa0f23c9a0f4 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:29.386531 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-820aecbe-495a-4a2c-a0c1-aa0f23c9a0f4 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:29.388084 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-820aecbe-495a-4a2c-a0c1-aa0f23c9a0f4 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:29.389228 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-820aecbe-495a-4a2c-a0c1-aa0f23c9a0f4 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1732 microversion: 2.20 time: 0.154439 Jun 01 04:37:29.389779 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 435/885] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:37:29 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:37:30.408832 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-35e5d3c7-e82d-4e99-9435-257301e2e7a0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:30.409537 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-35e5d3c7-e82d-4e99-9435-257301e2e7a0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:30.416393 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-35e5d3c7-e82d-4e99-9435-257301e2e7a0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:30.416845 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-35e5d3c7-e82d-4e99-9435-257301e2e7a0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:30.417606 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-35e5d3c7-e82d-4e99-9435-257301e2e7a0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:30.418043 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-35e5d3c7-e82d-4e99-9435-257301e2e7a0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:30.602285 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-35e5d3c7-e82d-4e99-9435-257301e2e7a0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:30.610453 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-35e5d3c7-e82d-4e99-9435-257301e2e7a0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:30.612015 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-35e5d3c7-e82d-4e99-9435-257301e2e7a0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:30.613164 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-35e5d3c7-e82d-4e99-9435-257301e2e7a0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1732 microversion: 2.20 time: 0.209086 Jun 01 04:37:30.613726 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 451/886] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:37:30 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1732 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:37:31.631177 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-58808ed3-eb2d-4c2c-aa90-52b1ba4e79e7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:31.631892 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-58808ed3-eb2d-4c2c-aa90-52b1ba4e79e7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:31.639065 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-58808ed3-eb2d-4c2c-aa90-52b1ba4e79e7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:31.639918 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-58808ed3-eb2d-4c2c-aa90-52b1ba4e79e7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:31.640050 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-58808ed3-eb2d-4c2c-aa90-52b1ba4e79e7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:31.640452 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-58808ed3-eb2d-4c2c-aa90-52b1ba4e79e7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:31.837994 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-58808ed3-eb2d-4c2c-aa90-52b1ba4e79e7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:31.845898 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-58808ed3-eb2d-4c2c-aa90-52b1ba4e79e7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:31.847500 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-58808ed3-eb2d-4c2c-aa90-52b1ba4e79e7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:31.849265 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-58808ed3-eb2d-4c2c-aa90-52b1ba4e79e7 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1732 microversion: 2.20 time: 0.222116 Jun 01 04:37:31.849818 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 436/887] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:37:31 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1732 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:37:32.868070 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-c84695b9-4549-41e2-8199-72c15051a46b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:32.868619 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-c84695b9-4549-41e2-8199-72c15051a46b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:32.875207 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c84695b9-4549-41e2-8199-72c15051a46b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:32.875639 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c84695b9-4549-41e2-8199-72c15051a46b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:32.876412 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c84695b9-4549-41e2-8199-72c15051a46b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:32.877034 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c84695b9-4549-41e2-8199-72c15051a46b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:33.005053 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-c84695b9-4549-41e2-8199-72c15051a46b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:33.013003 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-c84695b9-4549-41e2-8199-72c15051a46b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:33.014516 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-c84695b9-4549-41e2-8199-72c15051a46b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:33.015723 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-c84695b9-4549-41e2-8199-72c15051a46b tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1719 microversion: 2.20 time: 0.152304 Jun 01 04:37:33.016280 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 452/888] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:37:32 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:37:41.146279 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 01 04:37:41.146848 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Wed Jun 1 04:37:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 01 04:37:54.813057 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-82f428cb-4afa-4259-9eff-7a8e55746fae tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1344139541", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1514032961", "security_groups": [{"name": "tempest-secgroup-smoke-799074218"}], "block_device_mapping_v2": [{"uuid": "90e499fa-14e5-42e5-92ff-6dea1d17163b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e3dc963a-6f83-4418-ad4a-91353c23b06d"}]}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:37:54.822286 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_api:SELECT=11 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:54.822888 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=37 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:54.927555 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.network.neutron [None req-82f428cb-4afa-4259-9eff-7a8e55746fae tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] validate_networks() for [('e3dc963a-6f83-4418-ad4a-91353c23b06d', None, None, None, None, None)] {{(pid=118517) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 01 04:37:55.307732 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-82f428cb-4afa-4259-9eff-7a8e55746fae tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Flavor limits 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 01 04:37:55.308146 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-82f428cb-4afa-4259-9eff-7a8e55746fae tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Image limits 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 01 04:37:55.308642 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-82f428cb-4afa-4259-9eff-7a8e55746fae tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Flavor pref 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 01 04:37:55.309067 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-82f428cb-4afa-4259-9eff-7a8e55746fae tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Image pref 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 01 04:37:55.309471 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-82f428cb-4afa-4259-9eff-7a8e55746fae tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 01 04:37:55.318237 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-82f428cb-4afa-4259-9eff-7a8e55746fae tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:55.318676 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-82f428cb-4afa-4259-9eff-7a8e55746fae tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:55.319501 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-82f428cb-4afa-4259-9eff-7a8e55746fae tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:55.319933 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-82f428cb-4afa-4259-9eff-7a8e55746fae tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:55.336914 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.quota [None req-82f428cb-4afa-4259-9eff-7a8e55746fae tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Getting quotas for project 9369d530285849b3a9eac5e0034d3170. Resources: {'ram', 'instances', 'cores'} {{(pid=118517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:37:55.340707 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.quota [None req-82f428cb-4afa-4259-9eff-7a8e55746fae tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Getting quotas for user c052b2f518064843928b4eff569e913f and project 9369d530285849b3a9eac5e0034d3170. Resources: {'ram', 'instances', 'cores'} {{(pid=118517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:37:55.396317 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-82f428cb-4afa-4259-9eff-7a8e55746fae tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Going to run 1 instances... {{(pid=118517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 01 04:37:55.398452 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-82f428cb-4afa-4259-9eff-7a8e55746fae tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: ae96e93e-9319-4283-91f7-c2474eeb9927] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='90e499fa-14e5-42e5-92ff-6dea1d17163b',volume_size=None,volume_type=None)] {{(pid=118517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 01 04:37:55.736625 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-82f428cb-4afa-4259-9eff-7a8e55746fae tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.927655 Jun 01 04:37:55.737469 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 437/889] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 1 04:37:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 01 04:37:55.747962 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-4f2f404b-79d9-47f7-a66a-b356c151493f tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:55.750943 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-4f2f404b-79d9-47f7-a66a-b356c151493f tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: ae96e93e-9319-4283-91f7-c2474eeb9927] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:55.750943 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_api:SELECT=9 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:55.751783 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=20 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:55.808182 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-4f2f404b-79d9-47f7-a66a-b356c151493f tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:55.816939 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-4f2f404b-79d9-47f7-a66a-b356c151493f tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927" status: 200 len: 1095 microversion: 2.1 time: 0.072270 Jun 01 04:37:55.820903 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 453/890] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:37:55 2022] GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927 => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:37:56.834703 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-2226009e-2850-4cf2-82f7-2e8fe9fa1f7d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:56.835250 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-2226009e-2850-4cf2-82f7-2e8fe9fa1f7d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: ae96e93e-9319-4283-91f7-c2474eeb9927] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:56.842097 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2226009e-2850-4cf2-82f7-2e8fe9fa1f7d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:56.842538 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2226009e-2850-4cf2-82f7-2e8fe9fa1f7d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:56.843314 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2226009e-2850-4cf2-82f7-2e8fe9fa1f7d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:56.843753 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2226009e-2850-4cf2-82f7-2e8fe9fa1f7d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:56.909557 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-2226009e-2850-4cf2-82f7-2e8fe9fa1f7d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:56.918199 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-2226009e-2850-4cf2-82f7-2e8fe9fa1f7d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927" status: 200 len: 1145 microversion: 2.1 time: 0.088374 Jun 01 04:37:56.919050 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 438/891] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:37:56 2022] GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927 => generated 1145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:37:57.937485 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-fc548058-d7d1-4b7d-9efd-0740f409e62e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:57.938346 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-fc548058-d7d1-4b7d-9efd-0740f409e62e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: ae96e93e-9319-4283-91f7-c2474eeb9927] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:57.946066 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fc548058-d7d1-4b7d-9efd-0740f409e62e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:57.946523 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fc548058-d7d1-4b7d-9efd-0740f409e62e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:57.947296 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fc548058-d7d1-4b7d-9efd-0740f409e62e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:57.948030 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fc548058-d7d1-4b7d-9efd-0740f409e62e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:58.010728 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-fc548058-d7d1-4b7d-9efd-0740f409e62e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:58.018440 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-fc548058-d7d1-4b7d-9efd-0740f409e62e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927" status: 200 len: 1211 microversion: 2.1 time: 0.086014 Jun 01 04:37:58.019003 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 454/892] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:37:57 2022] GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927 => generated 1211 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:37:59.036679 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-56531d18-8d9d-402c-81f2-539d07cc42cc tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:37:59.037287 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-56531d18-8d9d-402c-81f2-539d07cc42cc tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: ae96e93e-9319-4283-91f7-c2474eeb9927] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:37:59.044105 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-56531d18-8d9d-402c-81f2-539d07cc42cc tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:59.044618 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-56531d18-8d9d-402c-81f2-539d07cc42cc tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:59.045551 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-56531d18-8d9d-402c-81f2-539d07cc42cc tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:59.046006 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-56531d18-8d9d-402c-81f2-539d07cc42cc tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:59.207673 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-56531d18-8d9d-402c-81f2-539d07cc42cc tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:37:59.215616 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-56531d18-8d9d-402c-81f2-539d07cc42cc tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927" status: 200 len: 1278 microversion: 2.1 time: 0.183321 Jun 01 04:37:59.216189 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 439/893] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:37:59 2022] GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927 => generated 1278 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:37:59.592483 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-e3463560-337d-4be2-aa25-0325bf9eb74c req-30de5362-f47f-4cc8-b80e-e1e6b1ad3d38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae96e93e-9319-4283-91f7-c2474eeb9927", "tag": "c95f4a69-1577-4402-b2af-06fb5349e287"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:37:59.604262 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-e3463560-337d-4be2-aa25-0325bf9eb74c req-30de5362-f47f-4cc8-b80e-e1e6b1ad3d38 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:37:59.605126 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-e3463560-337d-4be2-aa25-0325bf9eb74c req-30de5362-f47f-4cc8-b80e-e1e6b1ad3d38 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:37:59.626270 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-e3463560-337d-4be2-aa25-0325bf9eb74c req-30de5362-f47f-4cc8-b80e-e1e6b1ad3d38 service nova] Creating event network-changed:c95f4a69-1577-4402-b2af-06fb5349e287 for instance ae96e93e-9319-4283-91f7-c2474eeb9927 on hv-cinder-66710 Jun 01 04:37:59.631971 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-e3463560-337d-4be2-aa25-0325bf9eb74c req-30de5362-f47f-4cc8-b80e-e1e6b1ad3d38 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044026 Jun 01 04:37:59.632710 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 455/894] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:38:00.233333 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-00910be0-61e6-43de-833c-3c829e086300 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:00.234045 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-00910be0-61e6-43de-833c-3c829e086300 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: ae96e93e-9319-4283-91f7-c2474eeb9927] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:00.241183 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-00910be0-61e6-43de-833c-3c829e086300 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:00.241635 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-00910be0-61e6-43de-833c-3c829e086300 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:00.242405 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-00910be0-61e6-43de-833c-3c829e086300 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:00.242842 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-00910be0-61e6-43de-833c-3c829e086300 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:00.443833 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-00910be0-61e6-43de-833c-3c829e086300 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:00.451671 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-00910be0-61e6-43de-833c-3c829e086300 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927" status: 200 len: 1266 microversion: 2.1 time: 0.222381 Jun 01 04:38:00.454274 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 440/895] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:38:00 2022] GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927 => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:38:01.469944 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b5a588cb-0f06-43a1-947e-8d72c537d05d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:01.470661 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-b5a588cb-0f06-43a1-947e-8d72c537d05d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: ae96e93e-9319-4283-91f7-c2474eeb9927] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:01.476886 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b5a588cb-0f06-43a1-947e-8d72c537d05d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:01.477331 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b5a588cb-0f06-43a1-947e-8d72c537d05d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:01.478088 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b5a588cb-0f06-43a1-947e-8d72c537d05d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:01.478519 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b5a588cb-0f06-43a1-947e-8d72c537d05d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:01.609174 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b5a588cb-0f06-43a1-947e-8d72c537d05d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:01.617209 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-b5a588cb-0f06-43a1-947e-8d72c537d05d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927" status: 200 len: 1266 microversion: 2.1 time: 0.152006 Jun 01 04:38:01.617775 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 456/896] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:38:01 2022] GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:38:02.634012 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-14cc90ea-6fa9-48c9-a769-c742cf00b343 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:02.634633 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-14cc90ea-6fa9-48c9-a769-c742cf00b343 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: ae96e93e-9319-4283-91f7-c2474eeb9927] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:02.641649 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-14cc90ea-6fa9-48c9-a769-c742cf00b343 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:02.647791 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-14cc90ea-6fa9-48c9-a769-c742cf00b343 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:02.647791 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-14cc90ea-6fa9-48c9-a769-c742cf00b343 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:02.647791 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-14cc90ea-6fa9-48c9-a769-c742cf00b343 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:02.782066 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-14cc90ea-6fa9-48c9-a769-c742cf00b343 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:02.789798 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-14cc90ea-6fa9-48c9-a769-c742cf00b343 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927" status: 200 len: 1266 microversion: 2.1 time: 0.159614 Jun 01 04:38:02.790368 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 441/897] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:38:02 2022] GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:38:03.806051 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-05c36d73-bb83-4a51-85a4-2a1b2f0f6add tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:03.806698 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-05c36d73-bb83-4a51-85a4-2a1b2f0f6add tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: ae96e93e-9319-4283-91f7-c2474eeb9927] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:03.813345 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-05c36d73-bb83-4a51-85a4-2a1b2f0f6add tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:03.822089 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-05c36d73-bb83-4a51-85a4-2a1b2f0f6add tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:03.822089 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-05c36d73-bb83-4a51-85a4-2a1b2f0f6add tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:03.822089 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-05c36d73-bb83-4a51-85a4-2a1b2f0f6add tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:03.948866 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-05c36d73-bb83-4a51-85a4-2a1b2f0f6add tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:03.956399 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-05c36d73-bb83-4a51-85a4-2a1b2f0f6add tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927" status: 200 len: 1266 microversion: 2.1 time: 0.154220 Jun 01 04:38:03.956957 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 457/898] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:38:03 2022] GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:38:04.973177 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-801a50ce-42f2-4101-9b49-4a7c4bfdea7e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:04.973727 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-801a50ce-42f2-4101-9b49-4a7c4bfdea7e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: ae96e93e-9319-4283-91f7-c2474eeb9927] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:04.980293 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-801a50ce-42f2-4101-9b49-4a7c4bfdea7e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:04.980740 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-801a50ce-42f2-4101-9b49-4a7c4bfdea7e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:04.981499 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-801a50ce-42f2-4101-9b49-4a7c4bfdea7e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:04.981932 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-801a50ce-42f2-4101-9b49-4a7c4bfdea7e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:05.110279 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-801a50ce-42f2-4101-9b49-4a7c4bfdea7e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:05.117703 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-801a50ce-42f2-4101-9b49-4a7c4bfdea7e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927" status: 200 len: 1266 microversion: 2.1 time: 0.148558 Jun 01 04:38:05.118262 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 442/899] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:38:04 2022] GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:38:06.134583 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-5ccdbc6a-139f-46e8-942c-24689d258d2f tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:06.135133 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-5ccdbc6a-139f-46e8-942c-24689d258d2f tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: ae96e93e-9319-4283-91f7-c2474eeb9927] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:06.137164 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell0:SELECT=2 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:38:06.141989 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5ccdbc6a-139f-46e8-942c-24689d258d2f tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:06.142440 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5ccdbc6a-139f-46e8-942c-24689d258d2f tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:06.143208 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5ccdbc6a-139f-46e8-942c-24689d258d2f tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:06.143673 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5ccdbc6a-139f-46e8-942c-24689d258d2f tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:06.274037 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-5ccdbc6a-139f-46e8-942c-24689d258d2f tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:06.281664 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-5ccdbc6a-139f-46e8-942c-24689d258d2f tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927" status: 200 len: 1266 microversion: 2.1 time: 0.151148 Jun 01 04:38:06.282234 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 458/900] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:38:06 2022] GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:38:07.298911 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-136e517e-6cdb-470c-b63d-fbeaa486143d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:07.299554 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-136e517e-6cdb-470c-b63d-fbeaa486143d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: ae96e93e-9319-4283-91f7-c2474eeb9927] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:07.301522 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell0:SELECT=2 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:38:07.302169 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell0:SELECT=6 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:38:07.307652 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-136e517e-6cdb-470c-b63d-fbeaa486143d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:07.308153 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-136e517e-6cdb-470c-b63d-fbeaa486143d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:07.308914 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-136e517e-6cdb-470c-b63d-fbeaa486143d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:07.309344 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-136e517e-6cdb-470c-b63d-fbeaa486143d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:07.440341 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-136e517e-6cdb-470c-b63d-fbeaa486143d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:07.447873 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-136e517e-6cdb-470c-b63d-fbeaa486143d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927" status: 200 len: 1266 microversion: 2.1 time: 0.152882 Jun 01 04:38:07.448430 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 443/901] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:38:07 2022] GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:38:08.465120 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d716e31d-78eb-4722-b936-ace436d11d9e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:08.465734 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-d716e31d-78eb-4722-b936-ace436d11d9e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: ae96e93e-9319-4283-91f7-c2474eeb9927] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:08.472373 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d716e31d-78eb-4722-b936-ace436d11d9e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:08.472830 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d716e31d-78eb-4722-b936-ace436d11d9e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:08.473595 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d716e31d-78eb-4722-b936-ace436d11d9e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:08.474138 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d716e31d-78eb-4722-b936-ace436d11d9e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:08.605611 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-d716e31d-78eb-4722-b936-ace436d11d9e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:08.613824 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-d716e31d-78eb-4722-b936-ace436d11d9e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927" status: 200 len: 1266 microversion: 2.1 time: 0.152539 Jun 01 04:38:08.614402 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 459/902] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:38:08 2022] GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:38:09.631066 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a93f9c90-d8fe-411d-bbae-9849af32e87a tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:09.632211 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-a93f9c90-d8fe-411d-bbae-9849af32e87a tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: ae96e93e-9319-4283-91f7-c2474eeb9927] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:09.638737 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a93f9c90-d8fe-411d-bbae-9849af32e87a tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:09.639188 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a93f9c90-d8fe-411d-bbae-9849af32e87a tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:09.639988 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a93f9c90-d8fe-411d-bbae-9849af32e87a tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:09.640429 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a93f9c90-d8fe-411d-bbae-9849af32e87a tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:09.778651 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-a93f9c90-d8fe-411d-bbae-9849af32e87a tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:09.786156 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-a93f9c90-d8fe-411d-bbae-9849af32e87a tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927" status: 200 len: 1266 microversion: 2.1 time: 0.159157 Jun 01 04:38:09.786713 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 444/903] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:38:09 2022] GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:38:10.802144 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-86cd1c72-0e21-4672-8e7d-4d46942446ce tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:10.802926 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-86cd1c72-0e21-4672-8e7d-4d46942446ce tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: ae96e93e-9319-4283-91f7-c2474eeb9927] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:10.809532 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-86cd1c72-0e21-4672-8e7d-4d46942446ce tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:10.809993 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-86cd1c72-0e21-4672-8e7d-4d46942446ce tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:10.810947 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-86cd1c72-0e21-4672-8e7d-4d46942446ce tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:10.811430 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-86cd1c72-0e21-4672-8e7d-4d46942446ce tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:10.839544 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-9fbc1d07-6ec0-4a24-b8df-295084495fc8 req-6cf4de38-4b8e-4e38-bc06-0b90b6b38a66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae96e93e-9319-4283-91f7-c2474eeb9927", "name": "network-vif-plugged", "status": "completed", "tag": "c95f4a69-1577-4402-b2af-06fb5349e287"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:38:10.848838 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-9fbc1d07-6ec0-4a24-b8df-295084495fc8 req-6cf4de38-4b8e-4e38-bc06-0b90b6b38a66 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:10.849287 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-9fbc1d07-6ec0-4a24-b8df-295084495fc8 req-6cf4de38-4b8e-4e38-bc06-0b90b6b38a66 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:10.862764 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-9fbc1d07-6ec0-4a24-b8df-295084495fc8 req-6cf4de38-4b8e-4e38-bc06-0b90b6b38a66 service nova] Creating event network-vif-plugged:c95f4a69-1577-4402-b2af-06fb5349e287 for instance ae96e93e-9319-4283-91f7-c2474eeb9927 on hv-cinder-66710 Jun 01 04:38:10.867833 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-9fbc1d07-6ec0-4a24-b8df-295084495fc8 req-6cf4de38-4b8e-4e38-bc06-0b90b6b38a66 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031950 Jun 01 04:38:10.868694 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 445/904] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:38:10.951105 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-86cd1c72-0e21-4672-8e7d-4d46942446ce tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:10.958981 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-86cd1c72-0e21-4672-8e7d-4d46942446ce tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927" status: 200 len: 1266 microversion: 2.1 time: 0.160790 Jun 01 04:38:10.960240 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 460/905] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:38:10 2022] GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:38:11.978474 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-422a021d-e75c-41df-9378-7d0a8fc30a70 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:11.979074 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-422a021d-e75c-41df-9378-7d0a8fc30a70 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: ae96e93e-9319-4283-91f7-c2474eeb9927] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:11.985646 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-422a021d-e75c-41df-9378-7d0a8fc30a70 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:11.986093 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-422a021d-e75c-41df-9378-7d0a8fc30a70 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:11.986857 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-422a021d-e75c-41df-9378-7d0a8fc30a70 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:11.987295 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-422a021d-e75c-41df-9378-7d0a8fc30a70 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:12.122540 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-422a021d-e75c-41df-9378-7d0a8fc30a70 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:12.130187 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-422a021d-e75c-41df-9378-7d0a8fc30a70 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927" status: 200 len: 1266 microversion: 2.1 time: 0.157073 Jun 01 04:38:12.130916 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 446/906] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:38:11 2022] GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:38:13.148441 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-aae4d268-debd-485a-b92b-a7a153056883 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:13.149083 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-aae4d268-debd-485a-b92b-a7a153056883 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: ae96e93e-9319-4283-91f7-c2474eeb9927] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:13.155523 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-aae4d268-debd-485a-b92b-a7a153056883 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:13.156133 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-aae4d268-debd-485a-b92b-a7a153056883 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:13.156894 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-aae4d268-debd-485a-b92b-a7a153056883 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:13.157341 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-aae4d268-debd-485a-b92b-a7a153056883 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:13.294156 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-aae4d268-debd-485a-b92b-a7a153056883 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:13.301730 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-aae4d268-debd-485a-b92b-a7a153056883 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927" status: 200 len: 1266 microversion: 2.1 time: 0.157707 Jun 01 04:38:13.302452 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 461/907] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:38:13 2022] GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:38:14.319529 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-f9d88bec-4a23-41f4-b681-c1f3376a43cf tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:14.320215 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-f9d88bec-4a23-41f4-b681-c1f3376a43cf tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: ae96e93e-9319-4283-91f7-c2474eeb9927] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:14.326714 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f9d88bec-4a23-41f4-b681-c1f3376a43cf tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:14.327167 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f9d88bec-4a23-41f4-b681-c1f3376a43cf tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:14.328088 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f9d88bec-4a23-41f4-b681-c1f3376a43cf tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:14.328529 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f9d88bec-4a23-41f4-b681-c1f3376a43cf tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:14.460716 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-f9d88bec-4a23-41f4-b681-c1f3376a43cf tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:14.468311 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-f9d88bec-4a23-41f4-b681-c1f3376a43cf tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927" status: 200 len: 1452 microversion: 2.1 time: 0.153470 Jun 01 04:38:14.468867 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 447/908] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:38:14 2022] GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:38:14.484537 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-27c4cf16-da36-478b-8931-934f90840634 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:14.485155 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-27c4cf16-da36-478b-8931-934f90840634 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: ae96e93e-9319-4283-91f7-c2474eeb9927] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:14.491773 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-27c4cf16-da36-478b-8931-934f90840634 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:14.492230 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-27c4cf16-da36-478b-8931-934f90840634 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:14.492996 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-27c4cf16-da36-478b-8931-934f90840634 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:14.493434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-27c4cf16-da36-478b-8931-934f90840634 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:14.626231 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-27c4cf16-da36-478b-8931-934f90840634 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:14.634590 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-27c4cf16-da36-478b-8931-934f90840634 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927" status: 200 len: 1452 microversion: 2.1 time: 0.154185 Jun 01 04:38:14.635142 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 462/909] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:38:14 2022] GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:38:16.641157 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-409f6f6a-c4c6-4209-a69d-6f0952850302 req-9ab47013-3608-4b9d-9444-caf49727d6ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae96e93e-9319-4283-91f7-c2474eeb9927", "tag": "c95f4a69-1577-4402-b2af-06fb5349e287"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:38:16.649626 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-409f6f6a-c4c6-4209-a69d-6f0952850302 req-9ab47013-3608-4b9d-9444-caf49727d6ca service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:16.650074 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-409f6f6a-c4c6-4209-a69d-6f0952850302 req-9ab47013-3608-4b9d-9444-caf49727d6ca service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:16.661683 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-409f6f6a-c4c6-4209-a69d-6f0952850302 req-9ab47013-3608-4b9d-9444-caf49727d6ca service nova] Creating event network-changed:c95f4a69-1577-4402-b2af-06fb5349e287 for instance ae96e93e-9319-4283-91f7-c2474eeb9927 on hv-cinder-66710 Jun 01 04:38:16.667275 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-409f6f6a-c4c6-4209-a69d-6f0952850302 req-9ab47013-3608-4b9d-9444-caf49727d6ca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029875 Jun 01 04:38:16.667955 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 448/910] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:38:19.723082 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-490ad546-4d5f-4f69-8994-acac8cfbca45 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:19.723710 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-490ad546-4d5f-4f69-8994-acac8cfbca45 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:19.730792 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-490ad546-4d5f-4f69-8994-acac8cfbca45 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:19.731231 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-490ad546-4d5f-4f69-8994-acac8cfbca45 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:19.732038 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-490ad546-4d5f-4f69-8994-acac8cfbca45 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:19.732742 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-490ad546-4d5f-4f69-8994-acac8cfbca45 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:19.756616 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-490ad546-4d5f-4f69-8994-acac8cfbca45 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4/ips" status: 200 len: 144 microversion: 2.1 time: 0.037351 Jun 01 04:38:19.757110 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 463/911] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jun 1 04:38:19 2022] GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4/ips => generated 144 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:38:22.511903 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-e946e14d-c864-4395-b536-9786f1c5bf4d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f71b938-5006-4357-98a5-a682bb623a28"}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:38:22.513225 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-e946e14d-c864-4395-b536-9786f1c5bf4d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:22.520223 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e946e14d-c864-4395-b536-9786f1c5bf4d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:22.520668 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e946e14d-c864-4395-b536-9786f1c5bf4d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:22.521428 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e946e14d-c864-4395-b536-9786f1c5bf4d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:22.521856 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e946e14d-c864-4395-b536-9786f1c5bf4d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:23.337823 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-e946e14d-c864-4395-b536-9786f1c5bf4d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "POST /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.830667 Jun 01 04:38:23.338440 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 449/912] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 1 04:38:22 2022] POST /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4/os-volume_attachments => generated 194 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:38:31.879549 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-1d4c1928-4035-407e-a3cf-76d6d5a7fed8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:31.880474 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-1d4c1928-4035-407e-a3cf-76d6d5a7fed8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:31.882895 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_api:SELECT=24 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:38:31.883628 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=54 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:38:31.888252 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1d4c1928-4035-407e-a3cf-76d6d5a7fed8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:31.888707 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1d4c1928-4035-407e-a3cf-76d6d5a7fed8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:31.889474 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1d4c1928-4035-407e-a3cf-76d6d5a7fed8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:31.889913 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1d4c1928-4035-407e-a3cf-76d6d5a7fed8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:31.919995 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-1d4c1928-4035-407e-a3cf-76d6d5a7fed8 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044354 Jun 01 04:38:31.920598 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 464/913] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 1 04:38:31 2022] GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:38:31.933906 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-35ce41f5-1197-4527-9ee6-8a2aabd11f1c tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:31.937683 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-35ce41f5-1197-4527-9ee6-8a2aabd11f1c tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:31.937683 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:38:31.942263 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-35ce41f5-1197-4527-9ee6-8a2aabd11f1c tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:31.942712 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-35ce41f5-1197-4527-9ee6-8a2aabd11f1c tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:31.943512 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-35ce41f5-1197-4527-9ee6-8a2aabd11f1c tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:31.943954 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-35ce41f5-1197-4527-9ee6-8a2aabd11f1c tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:31.947536 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:38:31.972701 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-35ce41f5-1197-4527-9ee6-8a2aabd11f1c tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4/os-volume_attachments/3f71b938-5006-4357-98a5-a682bb623a28" status: 200 len: 194 microversion: 2.1 time: 0.043319 Jun 01 04:38:31.973279 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 450/914] 10.222.0.18 () {58 vars in 1412 bytes} [Wed Jun 1 04:38:31 2022] GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4/os-volume_attachments/3f71b938-5006-4357-98a5-a682bb623a28 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:38:34.616125 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-ffba7970-db88-409d-83b6-c5fae765e97b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "744de019-2e45-4991-8b3b-0e1cdcc6a7d2"}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:38:34.617188 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-ffba7970-db88-409d-83b6-c5fae765e97b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:34.624373 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ffba7970-db88-409d-83b6-c5fae765e97b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:34.624649 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ffba7970-db88-409d-83b6-c5fae765e97b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:34.625432 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ffba7970-db88-409d-83b6-c5fae765e97b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:34.625872 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ffba7970-db88-409d-83b6-c5fae765e97b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:35.428181 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-ffba7970-db88-409d-83b6-c5fae765e97b tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "POST /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.816229 Jun 01 04:38:35.428777 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 465/915] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 1 04:38:34 2022] POST /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4/os-volume_attachments => generated 194 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:38:40.364788 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-21ffc531-0c19-43a2-8088-a841f664e5d1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:40.365709 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-21ffc531-0c19-43a2-8088-a841f664e5d1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:40.373939 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-21ffc531-0c19-43a2-8088-a841f664e5d1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:40.374389 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-21ffc531-0c19-43a2-8088-a841f664e5d1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:40.375272 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-21ffc531-0c19-43a2-8088-a841f664e5d1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:40.375737 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-21ffc531-0c19-43a2-8088-a841f664e5d1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:40.405391 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-21ffc531-0c19-43a2-8088-a841f664e5d1 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045116 Jun 01 04:38:40.405943 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 451/916] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Jun 1 04:38:40 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:38:40.465263 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-6870c7df-b55f-44cd-bac3-909ae2a2229d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:40.465844 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-6870c7df-b55f-44cd-bac3-909ae2a2229d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:40.472207 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6870c7df-b55f-44cd-bac3-909ae2a2229d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:40.472655 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6870c7df-b55f-44cd-bac3-909ae2a2229d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:40.473424 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6870c7df-b55f-44cd-bac3-909ae2a2229d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:40.473854 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6870c7df-b55f-44cd-bac3-909ae2a2229d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:40.500936 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-6870c7df-b55f-44cd-bac3-909ae2a2229d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Going to try to terminate instance {{(pid=118516) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 01 04:38:40.800264 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-6870c7df-b55f-44cd-bac3-909ae2a2229d tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 204 len: 0 microversion: 2.20 time: 0.339371 Jun 01 04:38:40.800865 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 466/917] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Jun 1 04:38:40 2022] DELETE /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 01 04:38:40.809962 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-f2b0f293-5d29-4192-b318-ae6524d3e2aa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:40.810617 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-f2b0f293-5d29-4192-b318-ae6524d3e2aa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:40.817712 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f2b0f293-5d29-4192-b318-ae6524d3e2aa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:40.818164 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f2b0f293-5d29-4192-b318-ae6524d3e2aa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:40.818935 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f2b0f293-5d29-4192-b318-ae6524d3e2aa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:40.819397 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f2b0f293-5d29-4192-b318-ae6524d3e2aa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:40.954389 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-f2b0f293-5d29-4192-b318-ae6524d3e2aa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:40.962410 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-f2b0f293-5d29-4192-b318-ae6524d3e2aa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:40.964545 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-f2b0f293-5d29-4192-b318-ae6524d3e2aa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:40.965650 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-f2b0f293-5d29-4192-b318-ae6524d3e2aa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1725 microversion: 2.20 time: 0.160278 Jun 01 04:38:40.966202 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 452/918] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:38:40 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:38:41.985218 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-7b9b0aca-3cf7-4ca2-8da1-92c700db2ceb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:41.985907 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-7b9b0aca-3cf7-4ca2-8da1-92c700db2ceb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:41.992710 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7b9b0aca-3cf7-4ca2-8da1-92c700db2ceb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:41.993158 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7b9b0aca-3cf7-4ca2-8da1-92c700db2ceb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:41.993926 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7b9b0aca-3cf7-4ca2-8da1-92c700db2ceb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:41.994358 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7b9b0aca-3cf7-4ca2-8da1-92c700db2ceb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:42.127746 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-7b9b0aca-3cf7-4ca2-8da1-92c700db2ceb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:42.136537 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-7b9b0aca-3cf7-4ca2-8da1-92c700db2ceb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:42.138040 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-7b9b0aca-3cf7-4ca2-8da1-92c700db2ceb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:42.139197 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-7b9b0aca-3cf7-4ca2-8da1-92c700db2ceb tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1725 microversion: 2.20 time: 0.158522 Jun 01 04:38:42.139782 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 467/919] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:38:41 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:38:43.157822 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-af6ba476-a115-4d14-be12-05e3b91c0428 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:43.158433 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-af6ba476-a115-4d14-be12-05e3b91c0428 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:43.165020 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-af6ba476-a115-4d14-be12-05e3b91c0428 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:43.165481 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-af6ba476-a115-4d14-be12-05e3b91c0428 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:43.166314 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-af6ba476-a115-4d14-be12-05e3b91c0428 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:43.167290 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-af6ba476-a115-4d14-be12-05e3b91c0428 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:43.536444 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-af6ba476-a115-4d14-be12-05e3b91c0428 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:43.544618 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-af6ba476-a115-4d14-be12-05e3b91c0428 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:43.546173 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-af6ba476-a115-4d14-be12-05e3b91c0428 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:43.547384 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-af6ba476-a115-4d14-be12-05e3b91c0428 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1725 microversion: 2.20 time: 0.393455 Jun 01 04:38:43.547939 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 453/920] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:38:43 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1725 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 01 04:38:43.628499 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-dceb48e2-95a5-4eeb-938a-386c4742f08d tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1421609787"}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:38:43.629043 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-dceb48e2-95a5-4eeb-938a-386c4742f08d tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:43.636429 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-dceb48e2-95a5-4eeb-938a-386c4742f08d tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:43.636887 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-dceb48e2-95a5-4eeb-938a-386c4742f08d tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:43.637669 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-dceb48e2-95a5-4eeb-938a-386c4742f08d tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:43.638108 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-dceb48e2-95a5-4eeb-938a-386c4742f08d tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:43.856661 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.network.security_group_api [None req-dceb48e2-95a5-4eeb-938a-386c4742f08d tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Removing security group 7f9c6c9f-23db-4d5a-852b-3d3f4c028a1e from port fe4b660b-fcd7-4ccb-8056-f5657999e42f Jun 01 04:38:44.502126 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-dceb48e2-95a5-4eeb-938a-386c4742f08d tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "POST /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7/action" status: 202 len: 0 microversion: 2.1 time: 0.877386 Jun 01 04:38:44.502741 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 468/921] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 1 04:38:43 2022] POST /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7/action => generated 0 bytes in 879 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 01 04:38:44.566278 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-f7dd5656-29ba-42c5-9b44-cbbe12cb0c68 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:44.567142 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-f7dd5656-29ba-42c5-9b44-cbbe12cb0c68 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:44.578453 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f7dd5656-29ba-42c5-9b44-cbbe12cb0c68 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:44.578948 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f7dd5656-29ba-42c5-9b44-cbbe12cb0c68 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:44.583020 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f7dd5656-29ba-42c5-9b44-cbbe12cb0c68 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:44.583536 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f7dd5656-29ba-42c5-9b44-cbbe12cb0c68 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:44.647383 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-1d956c14-c1f1-4e3d-81fd-100ea6a2af8d req-ad20b3b0-a42b-427d-b1ef-caca08731de6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a901966-c203-41d4-9db4-e2a896daffa7", "tag": "fe4b660b-fcd7-4ccb-8056-f5657999e42f"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:38:44.665715 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-1d956c14-c1f1-4e3d-81fd-100ea6a2af8d req-ad20b3b0-a42b-427d-b1ef-caca08731de6 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:44.666166 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-1d956c14-c1f1-4e3d-81fd-100ea6a2af8d req-ad20b3b0-a42b-427d-b1ef-caca08731de6 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:44.695930 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-1d956c14-c1f1-4e3d-81fd-100ea6a2af8d req-ad20b3b0-a42b-427d-b1ef-caca08731de6 service nova] Creating event network-changed:fe4b660b-fcd7-4ccb-8056-f5657999e42f for instance 8a901966-c203-41d4-9db4-e2a896daffa7 on hv-cinder-66710 Jun 01 04:38:44.706810 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-1d956c14-c1f1-4e3d-81fd-100ea6a2af8d req-ad20b3b0-a42b-427d-b1ef-caca08731de6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194685 Jun 01 04:38:44.708105 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 454/922] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:38:44.717483 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-0f87d483-01b9-40c9-b104-7fea010845d3 req-1c1d2b0d-636f-483a-9a88-0beaad882755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3958973-f8ca-4c63-b27b-72c3e272604e", "name": "network-vif-deleted", "tag": "0b29defe-ef89-4b36-89eb-0cd5d2fb4aea"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:38:44.730530 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-0f87d483-01b9-40c9-b104-7fea010845d3 req-1c1d2b0d-636f-483a-9a88-0beaad882755 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:44.731180 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-0f87d483-01b9-40c9-b104-7fea010845d3 req-1c1d2b0d-636f-483a-9a88-0beaad882755 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:44.757460 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-f7dd5656-29ba-42c5-9b44-cbbe12cb0c68 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:44.765213 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-0f87d483-01b9-40c9-b104-7fea010845d3 req-1c1d2b0d-636f-483a-9a88-0beaad882755 service nova] Creating event network-vif-deleted:0b29defe-ef89-4b36-89eb-0cd5d2fb4aea for instance a3958973-f8ca-4c63-b27b-72c3e272604e on hv-cinder-66710 Jun 01 04:38:44.767866 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-f7dd5656-29ba-42c5-9b44-cbbe12cb0c68 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:44.774188 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-f7dd5656-29ba-42c5-9b44-cbbe12cb0c68 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:44.781035 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-f7dd5656-29ba-42c5-9b44-cbbe12cb0c68 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1657 microversion: 2.20 time: 0.218853 Jun 01 04:38:44.786930 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-0f87d483-01b9-40c9-b104-7fea010845d3 req-1c1d2b0d-636f-483a-9a88-0beaad882755 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074774 Jun 01 04:38:44.788237 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 455/923] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:38:44.793243 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 469/924] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:38:44 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1657 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:38:45.099384 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-c6d96535-64b6-45d0-ad71-49ed2a82d96f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:45.100721 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-c6d96535-64b6-45d0-ad71-49ed2a82d96f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:45.108031 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c6d96535-64b6-45d0-ad71-49ed2a82d96f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:45.108735 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c6d96535-64b6-45d0-ad71-49ed2a82d96f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:45.110274 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c6d96535-64b6-45d0-ad71-49ed2a82d96f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:45.110882 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c6d96535-64b6-45d0-ad71-49ed2a82d96f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:45.150162 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-c6d96535-64b6-45d0-ad71-49ed2a82d96f tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054996 Jun 01 04:38:45.155813 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 456/925] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 1 04:38:45 2022] GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4/os-volume_attachments => generated 371 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:38:45.305536 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-0705de07-b6ff-4b07-a0aa-08378551d345 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:45.306256 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-0705de07-b6ff-4b07-a0aa-08378551d345 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:45.313401 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0705de07-b6ff-4b07-a0aa-08378551d345 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:45.313999 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0705de07-b6ff-4b07-a0aa-08378551d345 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:45.314888 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0705de07-b6ff-4b07-a0aa-08378551d345 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:45.315678 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0705de07-b6ff-4b07-a0aa-08378551d345 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:45.354934 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-0705de07-b6ff-4b07-a0aa-08378551d345 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4/os-volume_attachments/3f71b938-5006-4357-98a5-a682bb623a28" status: 200 len: 194 microversion: 2.1 time: 0.053490 Jun 01 04:38:45.356103 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 470/926] 10.222.0.18 () {58 vars in 1412 bytes} [Wed Jun 1 04:38:45 2022] GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4/os-volume_attachments/3f71b938-5006-4357-98a5-a682bb623a28 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:38:45.366138 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-40219257-692f-4446-af6d-87cd6a0738bb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:45.366938 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-40219257-692f-4446-af6d-87cd6a0738bb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:45.374286 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-40219257-692f-4446-af6d-87cd6a0738bb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:45.374739 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-40219257-692f-4446-af6d-87cd6a0738bb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:45.375553 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-40219257-692f-4446-af6d-87cd6a0738bb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:45.376186 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-40219257-692f-4446-af6d-87cd6a0738bb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:45.465847 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.objects.instance [None req-40219257-692f-4446-af6d-87cd6a0738bb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lazy-loading 'services' on Instance uuid bf719576-f4a4-4035-9a04-d219fcd92bc4 {{(pid=118517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:38:45.747005 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-40219257-692f-4446-af6d-87cd6a0738bb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4/os-volume_attachments/3f71b938-5006-4357-98a5-a682bb623a28" status: 202 len: 0 microversion: 2.1 time: 0.384914 Jun 01 04:38:45.747843 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 457/927] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 1 04:38:45 2022] DELETE /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4/os-volume_attachments/3f71b938-5006-4357-98a5-a682bb623a28 => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 01 04:38:45.800074 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-29866fe0-ed4e-4da1-b3c7-c29c6b789daa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:45.801411 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-29866fe0-ed4e-4da1-b3c7-c29c6b789daa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:45.808670 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-29866fe0-ed4e-4da1-b3c7-c29c6b789daa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:45.810346 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-29866fe0-ed4e-4da1-b3c7-c29c6b789daa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:45.813168 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-29866fe0-ed4e-4da1-b3c7-c29c6b789daa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:45.813168 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-29866fe0-ed4e-4da1-b3c7-c29c6b789daa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:45.868525 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-29866fe0-ed4e-4da1-b3c7-c29c6b789daa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:45.869319 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-29866fe0-ed4e-4da1-b3c7-c29c6b789daa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:45.870576 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.objects.instance [None req-29866fe0-ed4e-4da1-b3c7-c29c6b789daa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lazy-loading 'fault' on Instance uuid a3958973-f8ca-4c63-b27b-72c3e272604e {{(pid=118516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:38:45.953155 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-29866fe0-ed4e-4da1-b3c7-c29c6b789daa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:45.992666 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-29866fe0-ed4e-4da1-b3c7-c29c6b789daa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:45.998212 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-29866fe0-ed4e-4da1-b3c7-c29c6b789daa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '85df2f6595d3489bb5d1d547cb2cd900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd12a9b5dc38b4aa7aed77adc89d0e6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:46.000031 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-29866fe0-ed4e-4da1-b3c7-c29c6b789daa tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 200 len: 1372 microversion: 2.20 time: 0.203868 Jun 01 04:38:46.000613 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 471/928] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:38:45 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 1372 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 01 04:38:46.540507 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-8c131e82-e1af-40c7-bf01-7c4ca78825b0 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:46.541118 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-8c131e82-e1af-40c7-bf01-7c4ca78825b0 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:46.547741 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8c131e82-e1af-40c7-bf01-7c4ca78825b0 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:46.548189 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8c131e82-e1af-40c7-bf01-7c4ca78825b0 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:46.548959 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8c131e82-e1af-40c7-bf01-7c4ca78825b0 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:46.550015 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8c131e82-e1af-40c7-bf01-7c4ca78825b0 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:46.631111 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.objects.instance [None req-8c131e82-e1af-40c7-bf01-7c4ca78825b0 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lazy-loading 'services' on Instance uuid 8a901966-c203-41d4-9db4-e2a896daffa7 {{(pid=118517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:38:46.771587 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-0e5b8ac3-b8c1-47b3-8f11-4407d1321692 req-ad5cdcf1-7168-4e77-9f14-a7d12483443a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a901966-c203-41d4-9db4-e2a896daffa7", "tag": "fe4b660b-fcd7-4ccb-8056-f5657999e42f"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:38:46.783825 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-0e5b8ac3-b8c1-47b3-8f11-4407d1321692 req-ad5cdcf1-7168-4e77-9f14-a7d12483443a service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:46.784269 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-0e5b8ac3-b8c1-47b3-8f11-4407d1321692 req-ad5cdcf1-7168-4e77-9f14-a7d12483443a service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:46.795949 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-0e5b8ac3-b8c1-47b3-8f11-4407d1321692 req-ad5cdcf1-7168-4e77-9f14-a7d12483443a service nova] Creating event network-changed:fe4b660b-fcd7-4ccb-8056-f5657999e42f for instance 8a901966-c203-41d4-9db4-e2a896daffa7 on hv-cinder-66710 Jun 01 04:38:46.801481 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-0e5b8ac3-b8c1-47b3-8f11-4407d1321692 req-ad5cdcf1-7168-4e77-9f14-a7d12483443a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033444 Jun 01 04:38:46.807492 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 472/929] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:38:46.829571 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-8c131e82-e1af-40c7-bf01-7c4ca78825b0 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7/os-volume_attachments/9aeb889d-0c03-4024-b4af-ac356c7452e7" status: 202 len: 0 microversion: 2.1 time: 0.294082 Jun 01 04:38:46.833854 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 458/930] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 1 04:38:46 2022] DELETE /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7/os-volume_attachments/9aeb889d-0c03-4024-b4af-ac356c7452e7 => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 01 04:38:46.840911 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-f64405af-3be2-4c28-804b-b3d51867c715 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:46.842019 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-f64405af-3be2-4c28-804b-b3d51867c715 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:46.849854 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f64405af-3be2-4c28-804b-b3d51867c715 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:46.850381 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f64405af-3be2-4c28-804b-b3d51867c715 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:46.852395 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f64405af-3be2-4c28-804b-b3d51867c715 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:46.853029 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f64405af-3be2-4c28-804b-b3d51867c715 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:46.889059 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-f64405af-3be2-4c28-804b-b3d51867c715 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053444 Jun 01 04:38:46.893775 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 473/931] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 1 04:38:46 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:38:47.018900 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-167c4900-1de9-4c1d-b1c1-d1f67bf4e2bd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:47.019907 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-167c4900-1de9-4c1d-b1c1-d1f67bf4e2bd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:47.026829 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-167c4900-1de9-4c1d-b1c1-d1f67bf4e2bd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:47.027744 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-167c4900-1de9-4c1d-b1c1-d1f67bf4e2bd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:47.028726 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-167c4900-1de9-4c1d-b1c1-d1f67bf4e2bd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:47.029452 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-167c4900-1de9-4c1d-b1c1-d1f67bf4e2bd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:47.043883 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.wsgi [None req-167c4900-1de9-4c1d-b1c1-d1f67bf4e2bd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] HTTP exception thrown: Instance a3958973-f8ca-4c63-b27b-72c3e272604e could not be found. Jun 01 04:38:47.046182 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-167c4900-1de9-4c1d-b1c1-d1f67bf4e2bd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Request method failure captured: Jun 01 04:38:47.046182 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: request: GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e HTTP/1.1 Jun 01 04:38:47.046182 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept: application/json Jun 01 04:38:47.046182 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept-Encoding: identity Jun 01 04:38:47.046182 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Connection: close Jun 01 04:38:47.046182 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Length: 0 Jun 01 04:38:47.046182 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Type: application/json Jun 01 04:38:47.046182 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Host: 10.222.0.18 Jun 01 04:38:47.046182 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Openstack-System-Scope: None Jun 01 04:38:47.046182 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: User-Agent: python-urllib3/1.26.9 Jun 01 04:38:47.046182 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Auth-Token: gAAAAABiluq5u7ypIc9ZITgsT-vtjIRhVrjbwIre77jcNdNH4pkI-gIRC-CEEogVH__Z1e-ykDxcRA7tO7281ReQsPia7LV9oIIFHcV5Qu2Cxp7-UCfgJagoD93i5Vm2b1dRvJIVRWHyQ3Qup-O_ZazwFabUI1ovDM5gGbUEJI_aNZBiMmWdTYo Jun 01 04:38:47.046182 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Id: None Jun 01 04:38:47.046182 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Name: None Jun 01 04:38:47.046182 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Identity-Status: Confirmed Jun 01 04:38:47.046182 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Is-Admin-Project: True Jun 01 04:38:47.046182 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Openstack-Nova-Api-Version: 2.20 Jun 01 04:38:47.046182 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Id: default Jun 01 04:38:47.046182 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Name: Default Jun 01 04:38:47.046182 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Id: d12a9b5dc38b4aa7aed77adc89d0e6a4 Jun 01 04:38:47.046182 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-228179451 Jun 01 04:38:47.046182 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Role: reader,member Jun 01 04:38:47.046182 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Roles: reader,member Jun 01 04:38:47.047951 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d12a9b5dc38b4aa7aed77adc89d0e6a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d12a9b5dc38b4aa7aed77adc89d0e6a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d12a9b5dc38b4aa7aed77adc89d0e6a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d12a9b5dc38b4aa7aed77adc89d0e6a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:38:47.047951 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant: tempest-AttachVolumeShelveTestJSON-228179451 Jun 01 04:38:47.047951 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Id: d12a9b5dc38b4aa7aed77adc89d0e6a4 Jun 01 04:38:47.047951 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-228179451 Jun 01 04:38:47.047951 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User: tempest-AttachVolumeShelveTestJSON-228179451-project Jun 01 04:38:47.047951 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Id: default Jun 01 04:38:47.047951 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Name: Default Jun 01 04:38:47.047951 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Id: 85df2f6595d3489bb5d1d547cb2cd900 Jun 01 04:38:47.047951 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Name: tempest-AttachVolumeShelveTestJSON-228179451-project Jun 01 04:38:47.047951 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: method: > Jun 01 04:38:47.047951 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: exception: Instance a3958973-f8ca-4c63-b27b-72c3e272604e could not be found. Jun 01 04:38:47.047951 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: action_args: {'id': 'a3958973-f8ca-4c63-b27b-72c3e272604e'} Jun 01 04:38:47.048874 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:38:47.048874 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:38:47.048874 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:38:47.048874 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:38:47.048874 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:38:47.048874 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:38:47.048874 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:38:47.048874 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:38:47.048874 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:38:47.048874 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:38:47.048874 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3958973-f8ca-4c63-b27b-72c3e272604e could not be found. Jun 01 04:38:47.048874 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:38:47.048874 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:38:47.048874 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:38:47.048874 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:38:47.048874 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:38:47.048874 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:38:47.048874 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:38:47.048874 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:38:47.048874 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:38:47.050414 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:38:47.050414 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 01 04:38:47.050414 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 01 04:38:47.050414 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:38:47.050414 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:38:47.050414 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:38:47.050414 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:38:47.050414 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3958973-f8ca-4c63-b27b-72c3e272604e could not be found. Jun 01 04:38:47.050414 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:38:47.050414 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:38:47.050414 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:38:47.050414 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:38:47.050414 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:38:47.050414 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:38:47.050414 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:38:47.050414 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:38:47.050414 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3958973-f8ca-4c63-b27b-72c3e272604e could not be found. Jun 01 04:38:47.050414 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:38:47.052278 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-167c4900-1de9-4c1d-b1c1-d1f67bf4e2bd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Returning 404 to user: Instance a3958973-f8ca-4c63-b27b-72c3e272604e could not be found. {{(pid=118517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:38:47.053306 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-167c4900-1de9-4c1d-b1c1-d1f67bf4e2bd tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 404 len: 111 microversion: 2.20 time: 0.038884 Jun 01 04:38:47.058056 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 459/932] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:38:47 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 01 04:38:47.063443 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-9e35605a-eac1-4689-bc9a-20aca2fccdf0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '.version_select at 0x7ff325d5de50>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:47.066839 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9e35605a-eac1-4689-bc9a-20aca2fccdf0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [cb6d4928-c0a3-4f01-a2aa-2a8f27c6c0e2] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 01 04:38:47.902181 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-f9bbb513-6440-41b8-9eb2-abbd39caa413 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:47.903341 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-f9bbb513-6440-41b8-9eb2-abbd39caa413 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:47.910713 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f9bbb513-6440-41b8-9eb2-abbd39caa413 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:47.911165 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f9bbb513-6440-41b8-9eb2-abbd39caa413 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:47.912001 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f9bbb513-6440-41b8-9eb2-abbd39caa413 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:47.912428 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f9bbb513-6440-41b8-9eb2-abbd39caa413 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:47.943828 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-f9bbb513-6440-41b8-9eb2-abbd39caa413 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046207 Jun 01 04:38:47.944369 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 460/933] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 1 04:38:47 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:38:47.976312 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-d761639c-079c-4c55-b5e2-2c344b71f121 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:47.976807 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-d761639c-079c-4c55-b5e2-2c344b71f121 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:47.983114 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d761639c-079c-4c55-b5e2-2c344b71f121 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:47.983607 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d761639c-079c-4c55-b5e2-2c344b71f121 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:47.984389 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d761639c-079c-4c55-b5e2-2c344b71f121 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:47.984834 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d761639c-079c-4c55-b5e2-2c344b71f121 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:48.013718 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-d761639c-079c-4c55-b5e2-2c344b71f121 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4/os-volume_attachments/744de019-2e45-4991-8b3b-0e1cdcc6a7d2" status: 200 len: 194 microversion: 2.1 time: 0.041355 Jun 01 04:38:48.014302 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 461/934] 10.222.0.18 () {58 vars in 1412 bytes} [Wed Jun 1 04:38:47 2022] GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4/os-volume_attachments/744de019-2e45-4991-8b3b-0e1cdcc6a7d2 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:38:48.023666 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-6ba62344-a4b6-4452-b099-a6a056c4501d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:48.024158 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-6ba62344-a4b6-4452-b099-a6a056c4501d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:48.030567 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6ba62344-a4b6-4452-b099-a6a056c4501d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:48.031023 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6ba62344-a4b6-4452-b099-a6a056c4501d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:48.031831 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6ba62344-a4b6-4452-b099-a6a056c4501d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:48.032274 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6ba62344-a4b6-4452-b099-a6a056c4501d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:48.074931 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO oslo.messaging._drivers.impl_rabbit [None req-9e35605a-eac1-4689-bc9a-20aca2fccdf0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [cb6d4928-c0a3-4f01-a2aa-2a8f27c6c0e2] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 32782. Jun 01 04:38:48.115020 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.objects.instance [None req-6ba62344-a4b6-4452-b099-a6a056c4501d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lazy-loading 'services' on Instance uuid bf719576-f4a4-4035-9a04-d219fcd92bc4 {{(pid=118517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:38:48.145226 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-9e35605a-eac1-4689-bc9a-20aca2fccdf0 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1546097504" status: 204 len: 0 microversion: 2.20 time: 1.086069 Jun 01 04:38:48.149483 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 474/935] 10.222.0.18 () {60 vars in 1261 bytes} [Wed Jun 1 04:38:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1546097504 => generated 0 bytes in 1087 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 01 04:38:48.402868 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-6ba62344-a4b6-4452-b099-a6a056c4501d tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4/os-volume_attachments/744de019-2e45-4991-8b3b-0e1cdcc6a7d2" status: 202 len: 0 microversion: 2.1 time: 0.380449 Jun 01 04:38:48.402868 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 462/936] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 1 04:38:48 2022] DELETE /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4/os-volume_attachments/744de019-2e45-4991-8b3b-0e1cdcc6a7d2 => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 01 04:38:48.956656 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-c4788188-8d9f-4334-82a1-5e7d3fb2fbd5 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:48.959068 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-c4788188-8d9f-4334-82a1-5e7d3fb2fbd5 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:48.965324 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c4788188-8d9f-4334-82a1-5e7d3fb2fbd5 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:48.965779 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c4788188-8d9f-4334-82a1-5e7d3fb2fbd5 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:48.966556 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c4788188-8d9f-4334-82a1-5e7d3fb2fbd5 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:48.966996 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c4788188-8d9f-4334-82a1-5e7d3fb2fbd5 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:48.994998 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-c4788188-8d9f-4334-82a1-5e7d3fb2fbd5 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042903 Jun 01 04:38:48.995592 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 475/937] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 1 04:38:48 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 01 04:38:49.006602 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-7d9eb5df-dce0-4517-9280-013390b9bf45 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:49.007204 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-7d9eb5df-dce0-4517-9280-013390b9bf45 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:49.014140 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7d9eb5df-dce0-4517-9280-013390b9bf45 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:49.014589 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7d9eb5df-dce0-4517-9280-013390b9bf45 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:49.015437 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7d9eb5df-dce0-4517-9280-013390b9bf45 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:49.015879 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7d9eb5df-dce0-4517-9280-013390b9bf45 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:49.094137 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.wsgi [None req-7d9eb5df-dce0-4517-9280-013390b9bf45 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] HTTP exception thrown: Instance 8a901966-c203-41d4-9db4-e2a896daffa7 is not attached to volume 9aeb889d-0c03-4024-b4af-ac356c7452e7 Jun 01 04:38:49.109405 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-7d9eb5df-dce0-4517-9280-013390b9bf45 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Request method failure captured: Jun 01 04:38:49.109405 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: request: DELETE /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7/os-volume_attachments/9aeb889d-0c03-4024-b4af-ac356c7452e7 HTTP/1.1 Jun 01 04:38:49.109405 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept: application/json Jun 01 04:38:49.109405 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept-Encoding: identity Jun 01 04:38:49.109405 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Connection: close Jun 01 04:38:49.109405 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Length: 0 Jun 01 04:38:49.109405 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Type: application/json Jun 01 04:38:49.109405 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Host: 10.222.0.18 Jun 01 04:38:49.109405 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Openstack-System-Scope: None Jun 01 04:38:49.109405 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: User-Agent: python-urllib3/1.26.9 Jun 01 04:38:49.109405 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Auth-Token: gAAAAABiluxmzr3bLbWe5lAEDhy7Zj3gJ9bJjWVPopiqdYBiHm__g3-Ec6AHFaMvWOjhttSjboHXsUGcD5NyKLjQ4QMdE0c_bYWL-Ig5hV5idrJmEeknpEgmCL-21qoL1nkYfUYWChX91nhZGf_5B_10losgM2bWXZ9RpndnPs5ux-sP2C_JtAw Jun 01 04:38:49.109405 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Id: None Jun 01 04:38:49.109405 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Name: None Jun 01 04:38:49.109405 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Identity-Status: Confirmed Jun 01 04:38:49.109405 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Is-Admin-Project: True Jun 01 04:38:49.109405 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Id: default Jun 01 04:38:49.109405 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Name: Default Jun 01 04:38:49.109405 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Id: cd5966396128491d814472e980cfd873 Jun 01 04:38:49.109405 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Name: tempest-TestMinimumBasicScenario-1690120754 Jun 01 04:38:49.109405 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Role: reader,member Jun 01 04:38:49.109405 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Roles: reader,member Jun 01 04:38:49.114221 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cd5966396128491d814472e980cfd873"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cd5966396128491d814472e980cfd873"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cd5966396128491d814472e980cfd873"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cd5966396128491d814472e980cfd873"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:38:49.114221 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant: tempest-TestMinimumBasicScenario-1690120754 Jun 01 04:38:49.114221 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Id: cd5966396128491d814472e980cfd873 Jun 01 04:38:49.114221 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1690120754 Jun 01 04:38:49.114221 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User: tempest-TestMinimumBasicScenario-1690120754-project Jun 01 04:38:49.114221 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Id: default Jun 01 04:38:49.114221 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Name: Default Jun 01 04:38:49.114221 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Id: 43b1ece3cb2e4fd6aa2d711bdff92dce Jun 01 04:38:49.114221 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Name: tempest-TestMinimumBasicScenario-1690120754-project Jun 01 04:38:49.114221 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: method: > Jun 01 04:38:49.114221 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: exception: Instance 8a901966-c203-41d4-9db4-e2a896daffa7 is not attached to volume 9aeb889d-0c03-4024-b4af-ac356c7452e7 Jun 01 04:38:49.115058 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: action_args: {'server_id': '8a901966-c203-41d4-9db4-e2a896daffa7', 'id': '9aeb889d-0c03-4024-b4af-ac356c7452e7'} Jun 01 04:38:49.115058 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:38:49.115058 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:38:49.115058 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 01 04:38:49.115058 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 01 04:38:49.115058 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 01 04:38:49.115058 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 01 04:38:49.115058 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 01 04:38:49.115058 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 01 04:38:49.115058 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9aeb889d-0c03-4024-b4af-ac356c7452e7. Jun 01 04:38:49.115058 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:38:49.115058 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:38:49.115058 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:38:49.115058 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:38:49.115058 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:38:49.115058 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:38:49.115058 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:38:49.115058 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:38:49.115058 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:38:49.116291 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:38:49.116291 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 01 04:38:49.116291 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 01 04:38:49.116291 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a901966-c203-41d4-9db4-e2a896daffa7 is not attached to volume 9aeb889d-0c03-4024-b4af-ac356c7452e7 Jun 01 04:38:49.116291 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:38:49.116291 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:38:49.116291 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:38:49.116291 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:38:49.116291 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:38:49.116291 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:38:49.116291 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:38:49.116291 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:38:49.116291 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a901966-c203-41d4-9db4-e2a896daffa7 is not attached to volume 9aeb889d-0c03-4024-b4af-ac356c7452e7 Jun 01 04:38:49.116291 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:38:49.116291 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-7d9eb5df-dce0-4517-9280-013390b9bf45 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Returning 404 to user: Instance 8a901966-c203-41d4-9db4-e2a896daffa7 is not attached to volume 9aeb889d-0c03-4024-b4af-ac356c7452e7 {{(pid=118517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:38:49.117222 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-7d9eb5df-dce0-4517-9280-013390b9bf45 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7/os-volume_attachments/9aeb889d-0c03-4024-b4af-ac356c7452e7" status: 404 len: 154 microversion: 2.1 time: 0.109811 Jun 01 04:38:49.117222 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 463/938] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 1 04:38:49 2022] DELETE /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7/os-volume_attachments/9aeb889d-0c03-4024-b4af-ac356c7452e7 => generated 154 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:38:49.571004 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-c217ad7c-2800-426a-9c41-be792baf39ce tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:49.571996 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-c217ad7c-2800-426a-9c41-be792baf39ce tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:49.578903 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c217ad7c-2800-426a-9c41-be792baf39ce tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:49.579543 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c217ad7c-2800-426a-9c41-be792baf39ce tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:49.580347 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c217ad7c-2800-426a-9c41-be792baf39ce tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:49.581125 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c217ad7c-2800-426a-9c41-be792baf39ce tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:49.612886 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-c217ad7c-2800-426a-9c41-be792baf39ce tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050075 Jun 01 04:38:49.613462 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 476/939] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 1 04:38:49 2022] GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:38:50.192879 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-2ef965fa-62f7-46b8-b5ef-8759937c1dfe tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:50.193403 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-2ef965fa-62f7-46b8-b5ef-8759937c1dfe tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:50.199975 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2ef965fa-62f7-46b8-b5ef-8759937c1dfe tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:50.200410 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2ef965fa-62f7-46b8-b5ef-8759937c1dfe tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:50.201170 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2ef965fa-62f7-46b8-b5ef-8759937c1dfe tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:50.201605 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2ef965fa-62f7-46b8-b5ef-8759937c1dfe tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:50.216386 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.wsgi [None req-2ef965fa-62f7-46b8-b5ef-8759937c1dfe tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] HTTP exception thrown: Instance a3958973-f8ca-4c63-b27b-72c3e272604e could not be found. Jun 01 04:38:50.217875 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-2ef965fa-62f7-46b8-b5ef-8759937c1dfe tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Request method failure captured: Jun 01 04:38:50.217875 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: request: DELETE /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e HTTP/1.1 Jun 01 04:38:50.217875 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept: application/json Jun 01 04:38:50.217875 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept-Encoding: identity Jun 01 04:38:50.217875 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Connection: close Jun 01 04:38:50.217875 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Length: 0 Jun 01 04:38:50.217875 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Type: application/json Jun 01 04:38:50.217875 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Host: 10.222.0.18 Jun 01 04:38:50.217875 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Openstack-System-Scope: None Jun 01 04:38:50.217875 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: User-Agent: python-urllib3/1.26.9 Jun 01 04:38:50.217875 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Auth-Token: gAAAAABiluq5u7ypIc9ZITgsT-vtjIRhVrjbwIre77jcNdNH4pkI-gIRC-CEEogVH__Z1e-ykDxcRA7tO7281ReQsPia7LV9oIIFHcV5Qu2Cxp7-UCfgJagoD93i5Vm2b1dRvJIVRWHyQ3Qup-O_ZazwFabUI1ovDM5gGbUEJI_aNZBiMmWdTYo Jun 01 04:38:50.217875 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Id: None Jun 01 04:38:50.217875 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Name: None Jun 01 04:38:50.217875 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Identity-Status: Confirmed Jun 01 04:38:50.217875 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Is-Admin-Project: True Jun 01 04:38:50.217875 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Openstack-Nova-Api-Version: 2.20 Jun 01 04:38:50.217875 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Id: default Jun 01 04:38:50.217875 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Name: Default Jun 01 04:38:50.217875 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Id: d12a9b5dc38b4aa7aed77adc89d0e6a4 Jun 01 04:38:50.217875 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-228179451 Jun 01 04:38:50.217875 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Role: reader,member Jun 01 04:38:50.217875 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Roles: reader,member Jun 01 04:38:50.219564 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d12a9b5dc38b4aa7aed77adc89d0e6a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d12a9b5dc38b4aa7aed77adc89d0e6a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d12a9b5dc38b4aa7aed77adc89d0e6a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d12a9b5dc38b4aa7aed77adc89d0e6a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:38:50.219564 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant: tempest-AttachVolumeShelveTestJSON-228179451 Jun 01 04:38:50.219564 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Id: d12a9b5dc38b4aa7aed77adc89d0e6a4 Jun 01 04:38:50.219564 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-228179451 Jun 01 04:38:50.219564 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User: tempest-AttachVolumeShelveTestJSON-228179451-project Jun 01 04:38:50.219564 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Id: default Jun 01 04:38:50.219564 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Name: Default Jun 01 04:38:50.219564 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Id: 85df2f6595d3489bb5d1d547cb2cd900 Jun 01 04:38:50.219564 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Name: tempest-AttachVolumeShelveTestJSON-228179451-project Jun 01 04:38:50.219564 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: method: > Jun 01 04:38:50.219564 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: exception: Instance a3958973-f8ca-4c63-b27b-72c3e272604e could not be found. Jun 01 04:38:50.219564 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: action_args: {'id': 'a3958973-f8ca-4c63-b27b-72c3e272604e'} Jun 01 04:38:50.220697 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:38:50.220697 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:38:50.220697 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:38:50.220697 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:38:50.220697 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:38:50.220697 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:38:50.220697 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:38:50.220697 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:38:50.220697 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:38:50.220697 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:38:50.220697 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3958973-f8ca-4c63-b27b-72c3e272604e could not be found. Jun 01 04:38:50.220697 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:38:50.220697 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:38:50.220697 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:38:50.220697 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:38:50.220697 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:38:50.220697 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:38:50.220697 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:38:50.220697 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:38:50.220697 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:38:50.222185 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:38:50.222185 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 01 04:38:50.222185 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 01 04:38:50.222185 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 01 04:38:50.222185 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 01 04:38:50.222185 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:38:50.222185 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:38:50.222185 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:38:50.222185 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:38:50.222185 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3958973-f8ca-4c63-b27b-72c3e272604e could not be found. Jun 01 04:38:50.222185 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:38:50.222185 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:38:50.222185 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:38:50.222185 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:38:50.222185 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:38:50.222185 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:38:50.222185 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:38:50.222185 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:38:50.222185 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3958973-f8ca-4c63-b27b-72c3e272604e could not be found. Jun 01 04:38:50.222185 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:38:50.223707 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-2ef965fa-62f7-46b8-b5ef-8759937c1dfe tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Returning 404 to user: Instance a3958973-f8ca-4c63-b27b-72c3e272604e could not be found. {{(pid=118517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:38:50.223707 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-2ef965fa-62f7-46b8-b5ef-8759937c1dfe tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 404 len: 111 microversion: 2.20 time: 0.030278 Jun 01 04:38:50.223707 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 464/940] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Jun 1 04:38:50 2022] DELETE /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 01 04:38:50.228232 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-8553b62c-423c-4101-b971-339d53b6cf2e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:50.229386 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-8553b62c-423c-4101-b971-339d53b6cf2e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: a3958973-f8ca-4c63-b27b-72c3e272604e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:50.236284 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8553b62c-423c-4101-b971-339d53b6cf2e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:50.236740 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8553b62c-423c-4101-b971-339d53b6cf2e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:50.237522 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8553b62c-423c-4101-b971-339d53b6cf2e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:50.238900 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8553b62c-423c-4101-b971-339d53b6cf2e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:50.253045 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.wsgi [None req-8553b62c-423c-4101-b971-339d53b6cf2e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] HTTP exception thrown: Instance a3958973-f8ca-4c63-b27b-72c3e272604e could not be found. Jun 01 04:38:50.254717 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-8553b62c-423c-4101-b971-339d53b6cf2e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Request method failure captured: Jun 01 04:38:50.254717 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: request: GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e HTTP/1.1 Jun 01 04:38:50.254717 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept: application/json Jun 01 04:38:50.254717 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept-Encoding: identity Jun 01 04:38:50.254717 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Connection: close Jun 01 04:38:50.254717 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Length: 0 Jun 01 04:38:50.254717 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Type: application/json Jun 01 04:38:50.254717 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Host: 10.222.0.18 Jun 01 04:38:50.254717 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Openstack-System-Scope: None Jun 01 04:38:50.254717 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: User-Agent: python-urllib3/1.26.9 Jun 01 04:38:50.254717 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Auth-Token: gAAAAABiluq5u7ypIc9ZITgsT-vtjIRhVrjbwIre77jcNdNH4pkI-gIRC-CEEogVH__Z1e-ykDxcRA7tO7281ReQsPia7LV9oIIFHcV5Qu2Cxp7-UCfgJagoD93i5Vm2b1dRvJIVRWHyQ3Qup-O_ZazwFabUI1ovDM5gGbUEJI_aNZBiMmWdTYo Jun 01 04:38:50.254717 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Id: None Jun 01 04:38:50.254717 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Name: None Jun 01 04:38:50.254717 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Identity-Status: Confirmed Jun 01 04:38:50.254717 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Is-Admin-Project: True Jun 01 04:38:50.254717 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Openstack-Nova-Api-Version: 2.20 Jun 01 04:38:50.254717 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Id: default Jun 01 04:38:50.254717 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Name: Default Jun 01 04:38:50.254717 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Id: d12a9b5dc38b4aa7aed77adc89d0e6a4 Jun 01 04:38:50.254717 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-228179451 Jun 01 04:38:50.254717 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Role: reader,member Jun 01 04:38:50.254717 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Roles: reader,member Jun 01 04:38:50.259035 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d12a9b5dc38b4aa7aed77adc89d0e6a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d12a9b5dc38b4aa7aed77adc89d0e6a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d12a9b5dc38b4aa7aed77adc89d0e6a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d12a9b5dc38b4aa7aed77adc89d0e6a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:38:50.259035 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant: tempest-AttachVolumeShelveTestJSON-228179451 Jun 01 04:38:50.259035 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Id: d12a9b5dc38b4aa7aed77adc89d0e6a4 Jun 01 04:38:50.259035 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-228179451 Jun 01 04:38:50.259035 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User: tempest-AttachVolumeShelveTestJSON-228179451-project Jun 01 04:38:50.259035 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Id: default Jun 01 04:38:50.259035 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Name: Default Jun 01 04:38:50.259035 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Id: 85df2f6595d3489bb5d1d547cb2cd900 Jun 01 04:38:50.259035 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Name: tempest-AttachVolumeShelveTestJSON-228179451-project Jun 01 04:38:50.259035 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: method: > Jun 01 04:38:50.259035 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: exception: Instance a3958973-f8ca-4c63-b27b-72c3e272604e could not be found. Jun 01 04:38:50.259035 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: action_args: {'id': 'a3958973-f8ca-4c63-b27b-72c3e272604e'} Jun 01 04:38:50.260325 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:38:50.260325 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:38:50.260325 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:38:50.260325 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:38:50.260325 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:38:50.260325 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:38:50.260325 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:38:50.260325 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:38:50.260325 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:38:50.260325 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:38:50.260325 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3958973-f8ca-4c63-b27b-72c3e272604e could not be found. Jun 01 04:38:50.260325 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:38:50.260325 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:38:50.260325 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:38:50.260325 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:38:50.260325 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:38:50.260325 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:38:50.260325 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:38:50.260325 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:38:50.260325 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:38:50.261747 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:38:50.261747 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 01 04:38:50.261747 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 01 04:38:50.261747 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:38:50.261747 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:38:50.261747 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:38:50.261747 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:38:50.261747 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3958973-f8ca-4c63-b27b-72c3e272604e could not be found. Jun 01 04:38:50.261747 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:38:50.261747 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:38:50.261747 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:38:50.261747 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:38:50.261747 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:38:50.261747 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:38:50.261747 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:38:50.261747 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:38:50.261747 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3958973-f8ca-4c63-b27b-72c3e272604e could not be found. Jun 01 04:38:50.261747 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:38:50.263556 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-8553b62c-423c-4101-b971-339d53b6cf2e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Returning 404 to user: Instance a3958973-f8ca-4c63-b27b-72c3e272604e could not be found. {{(pid=118516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:38:50.263556 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-8553b62c-423c-4101-b971-339d53b6cf2e tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e" status: 404 len: 111 microversion: 2.20 time: 0.031923 Jun 01 04:38:50.263556 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 477/941] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:38:50 2022] GET /compute/v2.1/servers/a3958973-f8ca-4c63-b27b-72c3e272604e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 01 04:38:50.461910 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-f561160f-5c13-4208-9c18-6aef89d81cd6 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:50.462389 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-f561160f-5c13-4208-9c18-6aef89d81cd6 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:50.468984 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f561160f-5c13-4208-9c18-6aef89d81cd6 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:50.469347 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f561160f-5c13-4208-9c18-6aef89d81cd6 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:50.470111 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f561160f-5c13-4208-9c18-6aef89d81cd6 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:50.470546 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f561160f-5c13-4208-9c18-6aef89d81cd6 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:50.498572 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-f561160f-5c13-4208-9c18-6aef89d81cd6 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Going to try to terminate instance {{(pid=118517) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 01 04:38:50.611459 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:38:50.624118 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-4c5917d7-149d-4567-aceb-f29d58ad8f95 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:50.625157 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-4c5917d7-149d-4567-aceb-f29d58ad8f95 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:50.631674 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4c5917d7-149d-4567-aceb-f29d58ad8f95 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:50.632020 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4c5917d7-149d-4567-aceb-f29d58ad8f95 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:50.632822 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4c5917d7-149d-4567-aceb-f29d58ad8f95 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:50.633244 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4c5917d7-149d-4567-aceb-f29d58ad8f95 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:50.662678 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-4c5917d7-149d-4567-aceb-f29d58ad8f95 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042544 Jun 01 04:38:50.663227 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 478/942] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 1 04:38:50 2022] GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 01 04:38:50.773526 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-8415c6cb-536e-4b4b-8c1b-86d6120605aa tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:50.776129 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-8415c6cb-536e-4b4b-8c1b-86d6120605aa tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:50.781298 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8415c6cb-536e-4b4b-8c1b-86d6120605aa tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:50.781757 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8415c6cb-536e-4b4b-8c1b-86d6120605aa tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:50.782542 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8415c6cb-536e-4b4b-8c1b-86d6120605aa tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:50.782988 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8415c6cb-536e-4b4b-8c1b-86d6120605aa tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:50.809470 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:38:50.813683 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-8415c6cb-536e-4b4b-8c1b-86d6120605aa tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044290 Jun 01 04:38:50.814246 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 479/943] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 1 04:38:50 2022] GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 01 04:38:50.824721 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-f561160f-5c13-4208-9c18-6aef89d81cd6 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 204 len: 0 microversion: 2.1 time: 0.366410 Jun 01 04:38:50.825336 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 465/944] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 1 04:38:50 2022] DELETE /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 01 04:38:50.834729 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-2f7273ca-37a2-482c-b0d8-3a8850efee2a tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:50.835428 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-2f7273ca-37a2-482c-b0d8-3a8850efee2a tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:50.842309 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2f7273ca-37a2-482c-b0d8-3a8850efee2a tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:50.842915 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2f7273ca-37a2-482c-b0d8-3a8850efee2a tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:50.843584 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2f7273ca-37a2-482c-b0d8-3a8850efee2a tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:50.844030 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2f7273ca-37a2-482c-b0d8-3a8850efee2a tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:50.875440 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-85a06e6c-3afb-4809-a6fb-a7042fcd1590 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:50.876306 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-85a06e6c-3afb-4809-a6fb-a7042fcd1590 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:50.882463 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-85a06e6c-3afb-4809-a6fb-a7042fcd1590 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:50.892710 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-85a06e6c-3afb-4809-a6fb-a7042fcd1590 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:50.892710 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-85a06e6c-3afb-4809-a6fb-a7042fcd1590 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:50.892710 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-85a06e6c-3afb-4809-a6fb-a7042fcd1590 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:50.911165 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-85a06e6c-3afb-4809-a6fb-a7042fcd1590 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Going to try to terminate instance {{(pid=118517) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 01 04:38:50.986584 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-2f7273ca-37a2-482c-b0d8-3a8850efee2a tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:50.994170 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-2f7273ca-37a2-482c-b0d8-3a8850efee2a tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1553 microversion: 2.1 time: 0.163376 Jun 01 04:38:50.994798 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 480/945] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:38:50 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:38:51.155431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-85a06e6c-3afb-4809-a6fb-a7042fcd1590 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4" status: 204 len: 0 microversion: 2.1 time: 0.285079 Jun 01 04:38:51.156026 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 466/946] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 1 04:38:50 2022] DELETE /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 01 04:38:51.165041 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-ee88ee3a-6efe-41fe-85dd-5c5720620a9e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:51.165645 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-ee88ee3a-6efe-41fe-85dd-5c5720620a9e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:51.172465 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ee88ee3a-6efe-41fe-85dd-5c5720620a9e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:51.173392 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ee88ee3a-6efe-41fe-85dd-5c5720620a9e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:51.174441 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ee88ee3a-6efe-41fe-85dd-5c5720620a9e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:51.174884 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-ee88ee3a-6efe-41fe-85dd-5c5720620a9e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:51.321442 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-ee88ee3a-6efe-41fe-85dd-5c5720620a9e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:51.329734 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-ee88ee3a-6efe-41fe-85dd-5c5720620a9e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4" status: 200 len: 1672 microversion: 2.1 time: 0.169413 Jun 01 04:38:51.330301 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 481/947] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:38:51 2022] GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4 => generated 1672 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:38:51.569738 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-98e4d785-db3e-48fc-975a-f19050dc3729 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:51.570309 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-98e4d785-db3e-48fc-975a-f19050dc3729 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:51.576750 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-98e4d785-db3e-48fc-975a-f19050dc3729 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:51.577189 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-98e4d785-db3e-48fc-975a-f19050dc3729 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:51.577974 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-98e4d785-db3e-48fc-975a-f19050dc3729 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:51.578406 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-98e4d785-db3e-48fc-975a-f19050dc3729 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:51.591892 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.wsgi [None req-98e4d785-db3e-48fc-975a-f19050dc3729 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] HTTP exception thrown: Instance c961e06b-1b03-4e97-8487-57adba5d5e16 could not be found. Jun 01 04:38:51.593518 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-98e4d785-db3e-48fc-975a-f19050dc3729 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Request method failure captured: Jun 01 04:38:51.593518 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: request: DELETE /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 HTTP/1.1 Jun 01 04:38:51.593518 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept: application/json Jun 01 04:38:51.593518 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept-Encoding: identity Jun 01 04:38:51.593518 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Connection: close Jun 01 04:38:51.593518 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Length: 0 Jun 01 04:38:51.593518 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Type: application/json Jun 01 04:38:51.593518 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Host: 10.222.0.18 Jun 01 04:38:51.593518 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Openstack-System-Scope: None Jun 01 04:38:51.593518 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: User-Agent: python-urllib3/1.26.9 Jun 01 04:38:51.593518 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Auth-Token: gAAAAABiluq5u7ypIc9ZITgsT-vtjIRhVrjbwIre77jcNdNH4pkI-gIRC-CEEogVH__Z1e-ykDxcRA7tO7281ReQsPia7LV9oIIFHcV5Qu2Cxp7-UCfgJagoD93i5Vm2b1dRvJIVRWHyQ3Qup-O_ZazwFabUI1ovDM5gGbUEJI_aNZBiMmWdTYo Jun 01 04:38:51.593518 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Id: None Jun 01 04:38:51.593518 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Name: None Jun 01 04:38:51.593518 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Identity-Status: Confirmed Jun 01 04:38:51.593518 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Is-Admin-Project: True Jun 01 04:38:51.593518 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Openstack-Nova-Api-Version: 2.20 Jun 01 04:38:51.593518 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Id: default Jun 01 04:38:51.593518 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Name: Default Jun 01 04:38:51.593518 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Id: d12a9b5dc38b4aa7aed77adc89d0e6a4 Jun 01 04:38:51.593518 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-228179451 Jun 01 04:38:51.593518 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Role: reader,member Jun 01 04:38:51.593518 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Roles: reader,member Jun 01 04:38:51.595175 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d12a9b5dc38b4aa7aed77adc89d0e6a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d12a9b5dc38b4aa7aed77adc89d0e6a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d12a9b5dc38b4aa7aed77adc89d0e6a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d12a9b5dc38b4aa7aed77adc89d0e6a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:38:51.595175 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant: tempest-AttachVolumeShelveTestJSON-228179451 Jun 01 04:38:51.595175 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Id: d12a9b5dc38b4aa7aed77adc89d0e6a4 Jun 01 04:38:51.595175 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-228179451 Jun 01 04:38:51.595175 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User: tempest-AttachVolumeShelveTestJSON-228179451-project Jun 01 04:38:51.595175 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Id: default Jun 01 04:38:51.595175 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Name: Default Jun 01 04:38:51.595175 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Id: 85df2f6595d3489bb5d1d547cb2cd900 Jun 01 04:38:51.595175 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Name: tempest-AttachVolumeShelveTestJSON-228179451-project Jun 01 04:38:51.595175 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: method: > Jun 01 04:38:51.595175 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: exception: Instance c961e06b-1b03-4e97-8487-57adba5d5e16 could not be found. Jun 01 04:38:51.595175 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: action_args: {'id': 'c961e06b-1b03-4e97-8487-57adba5d5e16'} Jun 01 04:38:51.596093 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:38:51.596093 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:38:51.596093 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:38:51.596093 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:38:51.596093 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:38:51.596093 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:38:51.596093 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:38:51.596093 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:38:51.596093 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:38:51.596093 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:38:51.596093 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c961e06b-1b03-4e97-8487-57adba5d5e16 could not be found. Jun 01 04:38:51.596093 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:38:51.596093 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:38:51.596093 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:38:51.596093 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:38:51.596093 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:38:51.596093 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:38:51.596093 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:38:51.596093 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:38:51.596093 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:38:51.597571 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:38:51.597571 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 01 04:38:51.597571 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 01 04:38:51.597571 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 01 04:38:51.597571 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 01 04:38:51.597571 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:38:51.597571 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:38:51.597571 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:38:51.597571 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:38:51.597571 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c961e06b-1b03-4e97-8487-57adba5d5e16 could not be found. Jun 01 04:38:51.597571 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:38:51.597571 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:38:51.597571 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:38:51.597571 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:38:51.597571 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:38:51.597571 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:38:51.597571 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:38:51.597571 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:38:51.597571 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c961e06b-1b03-4e97-8487-57adba5d5e16 could not be found. Jun 01 04:38:51.597571 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:38:51.599373 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-98e4d785-db3e-48fc-975a-f19050dc3729 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Returning 404 to user: Instance c961e06b-1b03-4e97-8487-57adba5d5e16 could not be found. {{(pid=118517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:38:51.599373 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-98e4d785-db3e-48fc-975a-f19050dc3729 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 404 len: 111 microversion: 2.20 time: 0.029319 Jun 01 04:38:51.599373 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 467/948] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Jun 1 04:38:51 2022] DELETE /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 01 04:38:51.603200 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-bb1791af-919b-43b9-a339-99eb516e3333 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:51.604531 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-bb1791af-919b-43b9-a339-99eb516e3333 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] [instance: c961e06b-1b03-4e97-8487-57adba5d5e16] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:51.610951 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bb1791af-919b-43b9-a339-99eb516e3333 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:51.611359 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bb1791af-919b-43b9-a339-99eb516e3333 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:51.612131 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bb1791af-919b-43b9-a339-99eb516e3333 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:51.612573 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bb1791af-919b-43b9-a339-99eb516e3333 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:51.626262 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.wsgi [None req-bb1791af-919b-43b9-a339-99eb516e3333 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] HTTP exception thrown: Instance c961e06b-1b03-4e97-8487-57adba5d5e16 could not be found. Jun 01 04:38:51.635444 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-bb1791af-919b-43b9-a339-99eb516e3333 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Request method failure captured: Jun 01 04:38:51.635444 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: request: GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 HTTP/1.1 Jun 01 04:38:51.635444 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept: application/json Jun 01 04:38:51.635444 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept-Encoding: identity Jun 01 04:38:51.635444 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Connection: close Jun 01 04:38:51.635444 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Length: 0 Jun 01 04:38:51.635444 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Type: application/json Jun 01 04:38:51.635444 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Host: 10.222.0.18 Jun 01 04:38:51.635444 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Openstack-System-Scope: None Jun 01 04:38:51.635444 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: User-Agent: python-urllib3/1.26.9 Jun 01 04:38:51.635444 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Auth-Token: gAAAAABiluq5u7ypIc9ZITgsT-vtjIRhVrjbwIre77jcNdNH4pkI-gIRC-CEEogVH__Z1e-ykDxcRA7tO7281ReQsPia7LV9oIIFHcV5Qu2Cxp7-UCfgJagoD93i5Vm2b1dRvJIVRWHyQ3Qup-O_ZazwFabUI1ovDM5gGbUEJI_aNZBiMmWdTYo Jun 01 04:38:51.635444 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Id: None Jun 01 04:38:51.635444 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Name: None Jun 01 04:38:51.635444 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Identity-Status: Confirmed Jun 01 04:38:51.635444 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Is-Admin-Project: True Jun 01 04:38:51.635444 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Openstack-Nova-Api-Version: 2.20 Jun 01 04:38:51.635444 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Id: default Jun 01 04:38:51.635444 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Name: Default Jun 01 04:38:51.635444 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Id: d12a9b5dc38b4aa7aed77adc89d0e6a4 Jun 01 04:38:51.635444 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-228179451 Jun 01 04:38:51.635444 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Role: reader,member Jun 01 04:38:51.635444 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Roles: reader,member Jun 01 04:38:51.638004 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d12a9b5dc38b4aa7aed77adc89d0e6a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d12a9b5dc38b4aa7aed77adc89d0e6a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d12a9b5dc38b4aa7aed77adc89d0e6a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d12a9b5dc38b4aa7aed77adc89d0e6a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:38:51.638004 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant: tempest-AttachVolumeShelveTestJSON-228179451 Jun 01 04:38:51.638004 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Id: d12a9b5dc38b4aa7aed77adc89d0e6a4 Jun 01 04:38:51.638004 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-228179451 Jun 01 04:38:51.638004 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User: tempest-AttachVolumeShelveTestJSON-228179451-project Jun 01 04:38:51.638004 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Id: default Jun 01 04:38:51.638004 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Name: Default Jun 01 04:38:51.638004 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Id: 85df2f6595d3489bb5d1d547cb2cd900 Jun 01 04:38:51.638004 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Name: tempest-AttachVolumeShelveTestJSON-228179451-project Jun 01 04:38:51.638004 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: method: > Jun 01 04:38:51.638004 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: exception: Instance c961e06b-1b03-4e97-8487-57adba5d5e16 could not be found. Jun 01 04:38:51.638004 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: action_args: {'id': 'c961e06b-1b03-4e97-8487-57adba5d5e16'} Jun 01 04:38:51.638885 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:38:51.638885 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:38:51.638885 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:38:51.638885 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:38:51.638885 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:38:51.638885 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:38:51.638885 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:38:51.638885 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:38:51.638885 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:38:51.638885 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:38:51.638885 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c961e06b-1b03-4e97-8487-57adba5d5e16 could not be found. Jun 01 04:38:51.638885 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:38:51.638885 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:38:51.638885 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:38:51.638885 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:38:51.638885 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:38:51.638885 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:38:51.638885 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:38:51.638885 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:38:51.638885 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:38:51.640542 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:38:51.640542 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 01 04:38:51.640542 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 01 04:38:51.640542 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:38:51.640542 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:38:51.640542 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:38:51.640542 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:38:51.640542 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c961e06b-1b03-4e97-8487-57adba5d5e16 could not be found. Jun 01 04:38:51.640542 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:38:51.640542 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:38:51.640542 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:38:51.640542 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:38:51.640542 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:38:51.640542 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:38:51.640542 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:38:51.640542 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:38:51.640542 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c961e06b-1b03-4e97-8487-57adba5d5e16 could not be found. Jun 01 04:38:51.640542 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:38:51.642331 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-bb1791af-919b-43b9-a339-99eb516e3333 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] Returning 404 to user: Instance c961e06b-1b03-4e97-8487-57adba5d5e16 could not be found. {{(pid=118516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:38:51.642331 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-bb1791af-919b-43b9-a339-99eb516e3333 tempest-AttachVolumeShelveTestJSON-228179451 tempest-AttachVolumeShelveTestJSON-228179451-project] 10.222.0.18 "GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16" status: 404 len: 111 microversion: 2.20 time: 0.029961 Jun 01 04:38:51.642331 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 482/949] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jun 1 04:38:51 2022] GET /compute/v2.1/servers/c961e06b-1b03-4e97-8487-57adba5d5e16 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 01 04:38:52.012511 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-91d8ee03-047b-4646-a451-a12d9a8d1f39 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:52.013132 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-91d8ee03-047b-4646-a451-a12d9a8d1f39 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:52.019686 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-91d8ee03-047b-4646-a451-a12d9a8d1f39 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:52.020146 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-91d8ee03-047b-4646-a451-a12d9a8d1f39 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:52.020926 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-91d8ee03-047b-4646-a451-a12d9a8d1f39 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:52.021366 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-91d8ee03-047b-4646-a451-a12d9a8d1f39 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:52.282794 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-91d8ee03-047b-4646-a451-a12d9a8d1f39 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:52.290420 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-91d8ee03-047b-4646-a451-a12d9a8d1f39 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1553 microversion: 2.1 time: 0.282296 Jun 01 04:38:52.291241 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 468/950] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:38:52 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1553 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:38:52.348367 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-50117371-c6ee-4597-981a-e06aef0620c4 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:52.349100 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-50117371-c6ee-4597-981a-e06aef0620c4 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:52.356106 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-50117371-c6ee-4597-981a-e06aef0620c4 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:52.356557 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-50117371-c6ee-4597-981a-e06aef0620c4 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:52.360752 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-50117371-c6ee-4597-981a-e06aef0620c4 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:52.360752 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-50117371-c6ee-4597-981a-e06aef0620c4 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:52.488628 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-50117371-c6ee-4597-981a-e06aef0620c4 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:52.497023 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-50117371-c6ee-4597-981a-e06aef0620c4 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4" status: 200 len: 1672 microversion: 2.1 time: 0.152675 Jun 01 04:38:52.497675 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 483/951] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:38:52 2022] GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:38:53.308483 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-2da88c2a-7f6c-4833-9b9f-ff0994098389 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:53.309098 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-2da88c2a-7f6c-4833-9b9f-ff0994098389 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:53.316547 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2da88c2a-7f6c-4833-9b9f-ff0994098389 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:53.317011 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2da88c2a-7f6c-4833-9b9f-ff0994098389 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:53.317790 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2da88c2a-7f6c-4833-9b9f-ff0994098389 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:53.318225 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2da88c2a-7f6c-4833-9b9f-ff0994098389 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:53.514759 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-38617c85-93ad-48bf-8235-8efe8e7a013a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:53.515501 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-38617c85-93ad-48bf-8235-8efe8e7a013a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:53.526782 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-2da88c2a-7f6c-4833-9b9f-ff0994098389 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:53.528735 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-38617c85-93ad-48bf-8235-8efe8e7a013a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:53.531919 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-38617c85-93ad-48bf-8235-8efe8e7a013a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:53.532802 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-38617c85-93ad-48bf-8235-8efe8e7a013a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:53.533251 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-38617c85-93ad-48bf-8235-8efe8e7a013a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:53.542905 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-2da88c2a-7f6c-4833-9b9f-ff0994098389 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1553 microversion: 2.1 time: 0.238324 Jun 01 04:38:53.550259 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 469/952] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:38:53 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1553 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:38:53.682731 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-38617c85-93ad-48bf-8235-8efe8e7a013a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:53.690763 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-38617c85-93ad-48bf-8235-8efe8e7a013a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4" status: 200 len: 1672 microversion: 2.1 time: 0.179962 Jun 01 04:38:53.691352 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 484/953] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:38:53 2022] GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4 => generated 1672 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:38:54.568344 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-6cec8ec9-05f3-4af0-8a38-2329ccd87831 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:54.568961 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-6cec8ec9-05f3-4af0-8a38-2329ccd87831 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:54.575233 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6cec8ec9-05f3-4af0-8a38-2329ccd87831 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:54.575614 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6cec8ec9-05f3-4af0-8a38-2329ccd87831 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:54.576738 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6cec8ec9-05f3-4af0-8a38-2329ccd87831 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:54.577150 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6cec8ec9-05f3-4af0-8a38-2329ccd87831 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:54.707880 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-0878c0b3-e85a-4d08-8cd0-5cd95d1f38f4 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:54.708503 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-0878c0b3-e85a-4d08-8cd0-5cd95d1f38f4 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:54.716656 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0878c0b3-e85a-4d08-8cd0-5cd95d1f38f4 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:54.717415 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0878c0b3-e85a-4d08-8cd0-5cd95d1f38f4 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:54.718518 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0878c0b3-e85a-4d08-8cd0-5cd95d1f38f4 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:54.719172 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0878c0b3-e85a-4d08-8cd0-5cd95d1f38f4 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:54.961457 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-0878c0b3-e85a-4d08-8cd0-5cd95d1f38f4 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:54.971965 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-0878c0b3-e85a-4d08-8cd0-5cd95d1f38f4 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4" status: 200 len: 1672 microversion: 2.1 time: 0.268160 Jun 01 04:38:54.973802 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 485/954] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:38:54 2022] GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4 => generated 1672 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:38:54.975463 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-6cec8ec9-05f3-4af0-8a38-2329ccd87831 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:54.984296 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-6cec8ec9-05f3-4af0-8a38-2329ccd87831 tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1553 microversion: 2.1 time: 0.420743 Jun 01 04:38:54.984864 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 470/955] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:38:54 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1553 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:38:55.247845 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-1e2768cb-4a5e-4f40-a28a-b3cd22d8c4f3 req-97a6ca3e-b2c0-4433-929d-015e946b8b3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a901966-c203-41d4-9db4-e2a896daffa7", "name": "network-vif-deleted", "tag": "fe4b660b-fcd7-4ccb-8056-f5657999e42f"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:38:55.261444 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-1e2768cb-4a5e-4f40-a28a-b3cd22d8c4f3 req-97a6ca3e-b2c0-4433-929d-015e946b8b3c service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:55.262100 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-1e2768cb-4a5e-4f40-a28a-b3cd22d8c4f3 req-97a6ca3e-b2c0-4433-929d-015e946b8b3c service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:55.274532 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-1e2768cb-4a5e-4f40-a28a-b3cd22d8c4f3 req-97a6ca3e-b2c0-4433-929d-015e946b8b3c service nova] Creating event network-vif-deleted:fe4b660b-fcd7-4ccb-8056-f5657999e42f for instance 8a901966-c203-41d4-9db4-e2a896daffa7 on hv-cinder-66710 Jun 01 04:38:55.279839 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-1e2768cb-4a5e-4f40-a28a-b3cd22d8c4f3 req-97a6ca3e-b2c0-4433-929d-015e946b8b3c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040305 Jun 01 04:38:55.280442 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 486/956] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:38:55.863015 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-95080267-7702-4d4e-b1a5-72b39cc060e1 req-708be86f-0f26-4356-827e-4e93fad2af7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf719576-f4a4-4035-9a04-d219fcd92bc4", "name": "network-vif-deleted", "tag": "4e9e2f71-edd1-4e77-8eea-aaca161637e1"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:38:55.877948 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-95080267-7702-4d4e-b1a5-72b39cc060e1 req-708be86f-0f26-4356-827e-4e93fad2af7b service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:55.879414 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-95080267-7702-4d4e-b1a5-72b39cc060e1 req-708be86f-0f26-4356-827e-4e93fad2af7b service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:55.894918 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-95080267-7702-4d4e-b1a5-72b39cc060e1 req-708be86f-0f26-4356-827e-4e93fad2af7b service nova] Creating event network-vif-deleted:4e9e2f71-edd1-4e77-8eea-aaca161637e1 for instance bf719576-f4a4-4035-9a04-d219fcd92bc4 on hv-cinder-66710 Jun 01 04:38:55.901443 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-95080267-7702-4d4e-b1a5-72b39cc060e1 req-708be86f-0f26-4356-827e-4e93fad2af7b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041739 Jun 01 04:38:55.902999 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 471/957] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:38:55.994524 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-2b982b02-f773-45ee-9f85-e033f6fac81a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:55.996146 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-2b982b02-f773-45ee-9f85-e033f6fac81a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:56.006114 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2b982b02-f773-45ee-9f85-e033f6fac81a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:56.007435 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2b982b02-f773-45ee-9f85-e033f6fac81a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:56.008267 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2b982b02-f773-45ee-9f85-e033f6fac81a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:56.008997 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2b982b02-f773-45ee-9f85-e033f6fac81a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:56.009420 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-0ecc69d2-ffbc-43bf-9e34-0c5006d1b5dc tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:56.010576 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-0ecc69d2-ffbc-43bf-9e34-0c5006d1b5dc tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:56.023897 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0ecc69d2-ffbc-43bf-9e34-0c5006d1b5dc tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:56.024471 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0ecc69d2-ffbc-43bf-9e34-0c5006d1b5dc tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:56.025978 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0ecc69d2-ffbc-43bf-9e34-0c5006d1b5dc tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:56.026471 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0ecc69d2-ffbc-43bf-9e34-0c5006d1b5dc tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:56.096099 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0ecc69d2-ffbc-43bf-9e34-0c5006d1b5dc tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:56.096655 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0ecc69d2-ffbc-43bf-9e34-0c5006d1b5dc tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:56.097686 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.objects.instance [None req-0ecc69d2-ffbc-43bf-9e34-0c5006d1b5dc tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lazy-loading 'fault' on Instance uuid 8a901966-c203-41d4-9db4-e2a896daffa7 {{(pid=118517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:38:56.103249 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-2b982b02-f773-45ee-9f85-e033f6fac81a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a147daff9846e699c26259fac4e004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e9dc06c3304c42a7fb6cbed1e357a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:56.116392 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-2b982b02-f773-45ee-9f85-e033f6fac81a tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4" status: 200 len: 1322 microversion: 2.1 time: 0.128124 Jun 01 04:38:56.127768 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 487/958] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:38:55 2022] GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4 => generated 1322 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:38:56.222299 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-0ecc69d2-ffbc-43bf-9e34-0c5006d1b5dc tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b1ece3cb2e4fd6aa2d711bdff92dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd5966396128491d814472e980cfd873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:38:56.242157 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-0ecc69d2-ffbc-43bf-9e34-0c5006d1b5dc tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 200 len: 1348 microversion: 2.1 time: 0.239134 Jun 01 04:38:56.247651 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 472/959] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:38:55 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 1348 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:38:57.133747 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-4b35cd5d-70d0-4155-a955-161394b2930e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:57.134560 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-4b35cd5d-70d0-4155-a955-161394b2930e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:57.142120 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4b35cd5d-70d0-4155-a955-161394b2930e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:57.142576 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4b35cd5d-70d0-4155-a955-161394b2930e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:57.143405 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4b35cd5d-70d0-4155-a955-161394b2930e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:57.143853 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4b35cd5d-70d0-4155-a955-161394b2930e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:57.160786 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.wsgi [None req-4b35cd5d-70d0-4155-a955-161394b2930e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] HTTP exception thrown: Instance bf719576-f4a4-4035-9a04-d219fcd92bc4 could not be found. Jun 01 04:38:57.162350 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-4b35cd5d-70d0-4155-a955-161394b2930e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Request method failure captured: Jun 01 04:38:57.162350 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: request: GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4 HTTP/1.1 Jun 01 04:38:57.162350 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept: application/json Jun 01 04:38:57.162350 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept-Encoding: identity Jun 01 04:38:57.162350 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Connection: close Jun 01 04:38:57.162350 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Length: 0 Jun 01 04:38:57.162350 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Type: application/json Jun 01 04:38:57.162350 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Host: 10.222.0.18 Jun 01 04:38:57.162350 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Openstack-System-Scope: None Jun 01 04:38:57.162350 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: User-Agent: python-urllib3/1.26.9 Jun 01 04:38:57.162350 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Auth-Token: gAAAAABilusaiXdJqCNwqWQdT51DbPmRD8pAHbwXzV3-587Eryc6oQNrE2kDJqR5Zfdfd4dT29qb52XgUVUJF2T7sVG0r2SImbd24oNQxvNf2TJGfTjV3WSWKUwmSGPc1LymdmFN8eDVOZqJgg-NDvjYVD9HDPa-uaUVGSa_UtV3DhVH_VMssqM Jun 01 04:38:57.162350 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Id: None Jun 01 04:38:57.162350 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Name: None Jun 01 04:38:57.162350 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Identity-Status: Confirmed Jun 01 04:38:57.162350 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Is-Admin-Project: True Jun 01 04:38:57.162350 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Id: default Jun 01 04:38:57.162350 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Name: Default Jun 01 04:38:57.162350 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Id: 89e9dc06c3304c42a7fb6cbed1e357a4 Jun 01 04:38:57.162350 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Name: tempest-AttachVolumeTestJSON-1274552074 Jun 01 04:38:57.162350 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Role: reader,member Jun 01 04:38:57.162350 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Roles: reader,member Jun 01 04:38:57.169084 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89e9dc06c3304c42a7fb6cbed1e357a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89e9dc06c3304c42a7fb6cbed1e357a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89e9dc06c3304c42a7fb6cbed1e357a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89e9dc06c3304c42a7fb6cbed1e357a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:38:57.169084 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant: tempest-AttachVolumeTestJSON-1274552074 Jun 01 04:38:57.169084 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Id: 89e9dc06c3304c42a7fb6cbed1e357a4 Jun 01 04:38:57.169084 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1274552074 Jun 01 04:38:57.169084 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User: tempest-AttachVolumeTestJSON-1274552074-project Jun 01 04:38:57.169084 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Id: default Jun 01 04:38:57.169084 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Name: Default Jun 01 04:38:57.169084 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Id: a0a147daff9846e699c26259fac4e004 Jun 01 04:38:57.169084 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Name: tempest-AttachVolumeTestJSON-1274552074-project Jun 01 04:38:57.169084 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: method: > Jun 01 04:38:57.169084 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: exception: Instance bf719576-f4a4-4035-9a04-d219fcd92bc4 could not be found. Jun 01 04:38:57.169084 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: action_args: {'id': 'bf719576-f4a4-4035-9a04-d219fcd92bc4'} Jun 01 04:38:57.169904 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:38:57.169904 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:38:57.169904 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:38:57.169904 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:38:57.169904 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:38:57.169904 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:38:57.169904 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:38:57.169904 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:38:57.169904 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:38:57.169904 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:38:57.169904 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf719576-f4a4-4035-9a04-d219fcd92bc4 could not be found. Jun 01 04:38:57.169904 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:38:57.169904 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:38:57.169904 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:38:57.169904 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:38:57.169904 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:38:57.169904 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:38:57.169904 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:38:57.169904 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:38:57.169904 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:38:57.171159 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:38:57.171159 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 01 04:38:57.171159 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 01 04:38:57.171159 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:38:57.171159 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:38:57.171159 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:38:57.171159 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:38:57.171159 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf719576-f4a4-4035-9a04-d219fcd92bc4 could not be found. Jun 01 04:38:57.171159 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:38:57.171159 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:38:57.171159 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:38:57.171159 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:38:57.171159 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:38:57.171159 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:38:57.171159 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:38:57.171159 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:38:57.171159 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf719576-f4a4-4035-9a04-d219fcd92bc4 could not be found. Jun 01 04:38:57.171159 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:38:57.172425 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-4b35cd5d-70d0-4155-a955-161394b2930e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Returning 404 to user: Instance bf719576-f4a4-4035-9a04-d219fcd92bc4 could not be found. {{(pid=118516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:38:57.172425 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-4b35cd5d-70d0-4155-a955-161394b2930e tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4" status: 404 len: 111 microversion: 2.1 time: 0.033967 Jun 01 04:38:57.172425 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 488/960] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:38:57 2022] GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:38:57.173007 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-f2ff0afa-4896-4ed1-befe-18e09a3426d7 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '.version_select at 0x7ff325a099d0>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:57.262707 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-84109f15-2dcd-440d-a20d-8fb49a42d42c tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:57.263367 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-84109f15-2dcd-440d-a20d-8fb49a42d42c tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] [instance: 8a901966-c203-41d4-9db4-e2a896daffa7] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:38:57.270932 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-f2ff0afa-4896-4ed1-befe-18e09a3426d7 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-754628665" status: 202 len: 0 microversion: 2.1 time: 0.101900 Jun 01 04:38:57.280421 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-84109f15-2dcd-440d-a20d-8fb49a42d42c tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:57.280932 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 473/961] 10.222.0.18 () {58 vars in 1217 bytes} [Wed Jun 1 04:38:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-754628665 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 01 04:38:57.281019 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-84109f15-2dcd-440d-a20d-8fb49a42d42c tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:57.281019 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-84109f15-2dcd-440d-a20d-8fb49a42d42c tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:38:57.281019 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-84109f15-2dcd-440d-a20d-8fb49a42d42c tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:38:57.289161 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.wsgi [None req-84109f15-2dcd-440d-a20d-8fb49a42d42c tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] HTTP exception thrown: Instance 8a901966-c203-41d4-9db4-e2a896daffa7 could not be found. Jun 01 04:38:57.290709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-84109f15-2dcd-440d-a20d-8fb49a42d42c tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Request method failure captured: Jun 01 04:38:57.290709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: request: GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 HTTP/1.1 Jun 01 04:38:57.290709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept: application/json Jun 01 04:38:57.290709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept-Encoding: identity Jun 01 04:38:57.290709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Connection: close Jun 01 04:38:57.290709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Length: 0 Jun 01 04:38:57.290709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Type: application/json Jun 01 04:38:57.290709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Host: 10.222.0.18 Jun 01 04:38:57.290709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Openstack-System-Scope: None Jun 01 04:38:57.290709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: User-Agent: python-urllib3/1.26.9 Jun 01 04:38:57.290709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Auth-Token: gAAAAABiluxmzr3bLbWe5lAEDhy7Zj3gJ9bJjWVPopiqdYBiHm__g3-Ec6AHFaMvWOjhttSjboHXsUGcD5NyKLjQ4QMdE0c_bYWL-Ig5hV5idrJmEeknpEgmCL-21qoL1nkYfUYWChX91nhZGf_5B_10losgM2bWXZ9RpndnPs5ux-sP2C_JtAw Jun 01 04:38:57.290709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Id: None Jun 01 04:38:57.290709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Name: None Jun 01 04:38:57.290709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Identity-Status: Confirmed Jun 01 04:38:57.290709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Is-Admin-Project: True Jun 01 04:38:57.290709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Id: default Jun 01 04:38:57.290709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Name: Default Jun 01 04:38:57.290709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Id: cd5966396128491d814472e980cfd873 Jun 01 04:38:57.290709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Name: tempest-TestMinimumBasicScenario-1690120754 Jun 01 04:38:57.290709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Role: reader,member Jun 01 04:38:57.290709 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Roles: reader,member Jun 01 04:38:57.292282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cd5966396128491d814472e980cfd873"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cd5966396128491d814472e980cfd873"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cd5966396128491d814472e980cfd873"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cd5966396128491d814472e980cfd873"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:38:57.292282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant: tempest-TestMinimumBasicScenario-1690120754 Jun 01 04:38:57.292282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Id: cd5966396128491d814472e980cfd873 Jun 01 04:38:57.292282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1690120754 Jun 01 04:38:57.292282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User: tempest-TestMinimumBasicScenario-1690120754-project Jun 01 04:38:57.292282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Id: default Jun 01 04:38:57.292282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Name: Default Jun 01 04:38:57.292282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Id: 43b1ece3cb2e4fd6aa2d711bdff92dce Jun 01 04:38:57.292282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Name: tempest-TestMinimumBasicScenario-1690120754-project Jun 01 04:38:57.292282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: method: > Jun 01 04:38:57.292282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: exception: Instance 8a901966-c203-41d4-9db4-e2a896daffa7 could not be found. Jun 01 04:38:57.292282 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: action_args: {'id': '8a901966-c203-41d4-9db4-e2a896daffa7'} Jun 01 04:38:57.293376 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:38:57.293376 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:38:57.293376 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:38:57.293376 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:38:57.293376 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:38:57.293376 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:38:57.293376 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:38:57.293376 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:38:57.293376 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:38:57.293376 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:38:57.293376 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a901966-c203-41d4-9db4-e2a896daffa7 could not be found. Jun 01 04:38:57.293376 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:38:57.293376 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:38:57.293376 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:38:57.293376 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:38:57.293376 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:38:57.293376 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:38:57.293376 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:38:57.293376 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:38:57.293376 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:38:57.294610 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:38:57.294610 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 01 04:38:57.294610 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 01 04:38:57.294610 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:38:57.294610 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:38:57.294610 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:38:57.294610 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:38:57.294610 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a901966-c203-41d4-9db4-e2a896daffa7 could not be found. Jun 01 04:38:57.294610 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:38:57.294610 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:38:57.294610 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:38:57.294610 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:38:57.294610 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:38:57.294610 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:38:57.294610 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:38:57.294610 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:38:57.294610 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a901966-c203-41d4-9db4-e2a896daffa7 could not be found. Jun 01 04:38:57.294610 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:38:57.295833 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-84109f15-2dcd-440d-a20d-8fb49a42d42c tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Returning 404 to user: Instance 8a901966-c203-41d4-9db4-e2a896daffa7 could not be found. {{(pid=118516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:38:57.295833 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-84109f15-2dcd-440d-a20d-8fb49a42d42c tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7" status: 404 len: 111 microversion: 2.1 time: 0.034044 Jun 01 04:38:57.295833 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 489/962] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:38:57 2022] GET /compute/v2.1/servers/8a901966-c203-41d4-9db4-e2a896daffa7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 01 04:38:57.300956 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-f7317ddc-864f-4243-b039-d687fa38183e tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] Calling method '.version_select at 0x7ff3259c35e0>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:38:57.368850 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-f7317ddc-864f-4243-b039-d687fa38183e tempest-TestMinimumBasicScenario-1690120754 tempest-TestMinimumBasicScenario-1690120754-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-117631107" status: 202 len: 0 microversion: 2.1 time: 0.071611 Jun 01 04:38:57.370985 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 474/963] 10.222.0.18 () {58 vars in 1268 bytes} [Wed Jun 1 04:38:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-117631107 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 01 04:39:00.679788 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-57bf2ef5-9819-422a-8139-3e31c94641c9 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:00.680315 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-57bf2ef5-9819-422a-8139-3e31c94641c9 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:00.687737 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-57bf2ef5-9819-422a-8139-3e31c94641c9 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:00.687972 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-57bf2ef5-9819-422a-8139-3e31c94641c9 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:00.688747 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-57bf2ef5-9819-422a-8139-3e31c94641c9 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:00.689192 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-57bf2ef5-9819-422a-8139-3e31c94641c9 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:00.712758 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.wsgi [None req-57bf2ef5-9819-422a-8139-3e31c94641c9 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] HTTP exception thrown: Instance bf719576-f4a4-4035-9a04-d219fcd92bc4 could not be found. Jun 01 04:39:00.716194 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-57bf2ef5-9819-422a-8139-3e31c94641c9 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Request method failure captured: Jun 01 04:39:00.716194 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: request: DELETE /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4 HTTP/1.1 Jun 01 04:39:00.716194 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept: application/json Jun 01 04:39:00.716194 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept-Encoding: identity Jun 01 04:39:00.716194 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Connection: close Jun 01 04:39:00.716194 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Length: 0 Jun 01 04:39:00.716194 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Type: application/json Jun 01 04:39:00.716194 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Host: 10.222.0.18 Jun 01 04:39:00.716194 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Openstack-System-Scope: None Jun 01 04:39:00.716194 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: User-Agent: python-urllib3/1.26.9 Jun 01 04:39:00.716194 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Auth-Token: gAAAAABilusaiXdJqCNwqWQdT51DbPmRD8pAHbwXzV3-587Eryc6oQNrE2kDJqR5Zfdfd4dT29qb52XgUVUJF2T7sVG0r2SImbd24oNQxvNf2TJGfTjV3WSWKUwmSGPc1LymdmFN8eDVOZqJgg-NDvjYVD9HDPa-uaUVGSa_UtV3DhVH_VMssqM Jun 01 04:39:00.716194 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Id: None Jun 01 04:39:00.716194 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Name: None Jun 01 04:39:00.716194 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Identity-Status: Confirmed Jun 01 04:39:00.716194 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Is-Admin-Project: True Jun 01 04:39:00.716194 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Id: default Jun 01 04:39:00.716194 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Name: Default Jun 01 04:39:00.716194 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Id: 89e9dc06c3304c42a7fb6cbed1e357a4 Jun 01 04:39:00.716194 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Name: tempest-AttachVolumeTestJSON-1274552074 Jun 01 04:39:00.716194 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Role: reader,member Jun 01 04:39:00.716194 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Roles: reader,member Jun 01 04:39:00.720451 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89e9dc06c3304c42a7fb6cbed1e357a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89e9dc06c3304c42a7fb6cbed1e357a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89e9dc06c3304c42a7fb6cbed1e357a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89e9dc06c3304c42a7fb6cbed1e357a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:39:00.720451 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant: tempest-AttachVolumeTestJSON-1274552074 Jun 01 04:39:00.720451 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Id: 89e9dc06c3304c42a7fb6cbed1e357a4 Jun 01 04:39:00.720451 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1274552074 Jun 01 04:39:00.720451 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User: tempest-AttachVolumeTestJSON-1274552074-project Jun 01 04:39:00.720451 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Id: default Jun 01 04:39:00.720451 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Name: Default Jun 01 04:39:00.720451 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Id: a0a147daff9846e699c26259fac4e004 Jun 01 04:39:00.720451 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Name: tempest-AttachVolumeTestJSON-1274552074-project Jun 01 04:39:00.720451 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: method: > Jun 01 04:39:00.720451 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: exception: Instance bf719576-f4a4-4035-9a04-d219fcd92bc4 could not be found. Jun 01 04:39:00.720451 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: action_args: {'id': 'bf719576-f4a4-4035-9a04-d219fcd92bc4'} Jun 01 04:39:00.721288 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:39:00.721288 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:39:00.721288 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:39:00.721288 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:39:00.721288 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:39:00.721288 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:39:00.721288 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:39:00.721288 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:39:00.721288 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:39:00.721288 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:39:00.721288 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf719576-f4a4-4035-9a04-d219fcd92bc4 could not be found. Jun 01 04:39:00.721288 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:39:00.721288 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:39:00.721288 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:39:00.721288 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:39:00.721288 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:39:00.721288 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:39:00.721288 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:39:00.721288 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:39:00.721288 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:39:00.722535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:39:00.722535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 01 04:39:00.722535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 01 04:39:00.722535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 01 04:39:00.722535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 01 04:39:00.722535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:39:00.722535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:39:00.722535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:39:00.722535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:39:00.722535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf719576-f4a4-4035-9a04-d219fcd92bc4 could not be found. Jun 01 04:39:00.722535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:39:00.722535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:39:00.722535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:39:00.722535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:39:00.722535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:39:00.722535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:39:00.722535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:39:00.722535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:39:00.722535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf719576-f4a4-4035-9a04-d219fcd92bc4 could not be found. Jun 01 04:39:00.722535 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:39:00.723804 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-57bf2ef5-9819-422a-8139-3e31c94641c9 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Returning 404 to user: Instance bf719576-f4a4-4035-9a04-d219fcd92bc4 could not be found. {{(pid=118516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:39:00.723804 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-57bf2ef5-9819-422a-8139-3e31c94641c9 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4" status: 404 len: 111 microversion: 2.1 time: 0.040110 Jun 01 04:39:00.723804 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 490/964] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 1 04:39:00 2022] DELETE /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:39:00.727564 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-20ace409-cf41-4063-b1bc-0548e8703f63 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:00.728184 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-20ace409-cf41-4063-b1bc-0548e8703f63 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: bf719576-f4a4-4035-9a04-d219fcd92bc4] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:00.739910 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-20ace409-cf41-4063-b1bc-0548e8703f63 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:00.740441 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-20ace409-cf41-4063-b1bc-0548e8703f63 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:00.741359 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-20ace409-cf41-4063-b1bc-0548e8703f63 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:00.741876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-20ace409-cf41-4063-b1bc-0548e8703f63 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:00.765324 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.wsgi [None req-20ace409-cf41-4063-b1bc-0548e8703f63 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] HTTP exception thrown: Instance bf719576-f4a4-4035-9a04-d219fcd92bc4 could not be found. Jun 01 04:39:00.766980 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-20ace409-cf41-4063-b1bc-0548e8703f63 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Request method failure captured: Jun 01 04:39:00.766980 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: request: GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4 HTTP/1.1 Jun 01 04:39:00.766980 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept: application/json Jun 01 04:39:00.766980 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept-Encoding: identity Jun 01 04:39:00.766980 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Connection: close Jun 01 04:39:00.766980 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Length: 0 Jun 01 04:39:00.766980 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Type: application/json Jun 01 04:39:00.766980 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Host: 10.222.0.18 Jun 01 04:39:00.766980 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Openstack-System-Scope: None Jun 01 04:39:00.766980 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: User-Agent: python-urllib3/1.26.9 Jun 01 04:39:00.766980 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Auth-Token: gAAAAABilusaiXdJqCNwqWQdT51DbPmRD8pAHbwXzV3-587Eryc6oQNrE2kDJqR5Zfdfd4dT29qb52XgUVUJF2T7sVG0r2SImbd24oNQxvNf2TJGfTjV3WSWKUwmSGPc1LymdmFN8eDVOZqJgg-NDvjYVD9HDPa-uaUVGSa_UtV3DhVH_VMssqM Jun 01 04:39:00.766980 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Id: None Jun 01 04:39:00.766980 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Name: None Jun 01 04:39:00.766980 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Identity-Status: Confirmed Jun 01 04:39:00.766980 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Is-Admin-Project: True Jun 01 04:39:00.766980 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Id: default Jun 01 04:39:00.766980 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Name: Default Jun 01 04:39:00.766980 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Id: 89e9dc06c3304c42a7fb6cbed1e357a4 Jun 01 04:39:00.766980 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Name: tempest-AttachVolumeTestJSON-1274552074 Jun 01 04:39:00.766980 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Role: reader,member Jun 01 04:39:00.766980 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Roles: reader,member Jun 01 04:39:00.776159 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89e9dc06c3304c42a7fb6cbed1e357a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89e9dc06c3304c42a7fb6cbed1e357a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89e9dc06c3304c42a7fb6cbed1e357a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89e9dc06c3304c42a7fb6cbed1e357a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:39:00.776159 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant: tempest-AttachVolumeTestJSON-1274552074 Jun 01 04:39:00.776159 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Id: 89e9dc06c3304c42a7fb6cbed1e357a4 Jun 01 04:39:00.776159 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1274552074 Jun 01 04:39:00.776159 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User: tempest-AttachVolumeTestJSON-1274552074-project Jun 01 04:39:00.776159 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Id: default Jun 01 04:39:00.776159 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Name: Default Jun 01 04:39:00.776159 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Id: a0a147daff9846e699c26259fac4e004 Jun 01 04:39:00.776159 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Name: tempest-AttachVolumeTestJSON-1274552074-project Jun 01 04:39:00.776159 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: method: > Jun 01 04:39:00.776159 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: exception: Instance bf719576-f4a4-4035-9a04-d219fcd92bc4 could not be found. Jun 01 04:39:00.776159 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: action_args: {'id': 'bf719576-f4a4-4035-9a04-d219fcd92bc4'} Jun 01 04:39:00.777231 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:39:00.777231 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:39:00.777231 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:39:00.777231 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:39:00.777231 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:39:00.777231 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:39:00.777231 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:39:00.777231 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:39:00.777231 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:39:00.777231 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:39:00.777231 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf719576-f4a4-4035-9a04-d219fcd92bc4 could not be found. Jun 01 04:39:00.777231 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:39:00.777231 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:39:00.777231 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:39:00.777231 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:39:00.777231 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:39:00.777231 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:39:00.777231 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:39:00.777231 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:39:00.777231 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:39:00.778742 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:39:00.778742 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 01 04:39:00.778742 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 01 04:39:00.778742 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:39:00.778742 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:39:00.778742 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:39:00.778742 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:39:00.778742 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf719576-f4a4-4035-9a04-d219fcd92bc4 could not be found. Jun 01 04:39:00.778742 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:39:00.778742 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:39:00.778742 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:39:00.778742 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:39:00.778742 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:39:00.778742 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:39:00.778742 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:39:00.778742 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:39:00.778742 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf719576-f4a4-4035-9a04-d219fcd92bc4 could not be found. Jun 01 04:39:00.778742 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:39:00.781420 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-20ace409-cf41-4063-b1bc-0548e8703f63 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Returning 404 to user: Instance bf719576-f4a4-4035-9a04-d219fcd92bc4 could not be found. {{(pid=118517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:39:00.781420 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-20ace409-cf41-4063-b1bc-0548e8703f63 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4" status: 404 len: 111 microversion: 2.1 time: 0.045596 Jun 01 04:39:00.781420 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 475/965] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:39:00 2022] GET /compute/v2.1/servers/bf719576-f4a4-4035-9a04-d219fcd92bc4 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:39:02.106476 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-67a6be6d-323a-445d-a522-8116e386f2cb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:02.117744 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-67a6be6d-323a-445d-a522-8116e386f2cb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:02.117744 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-67a6be6d-323a-445d-a522-8116e386f2cb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:02.117744 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-67a6be6d-323a-445d-a522-8116e386f2cb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:02.117744 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-67a6be6d-323a-445d-a522-8116e386f2cb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:02.118368 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-67a6be6d-323a-445d-a522-8116e386f2cb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:02.148434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.wsgi [None req-67a6be6d-323a-445d-a522-8116e386f2cb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] HTTP exception thrown: Instance f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 could not be found. Jun 01 04:39:02.148434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-67a6be6d-323a-445d-a522-8116e386f2cb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Request method failure captured: Jun 01 04:39:02.148434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: request: DELETE /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 HTTP/1.1 Jun 01 04:39:02.148434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept: application/json Jun 01 04:39:02.148434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept-Encoding: identity Jun 01 04:39:02.148434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Connection: close Jun 01 04:39:02.148434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Length: 0 Jun 01 04:39:02.148434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Type: application/json Jun 01 04:39:02.148434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Host: 10.222.0.18 Jun 01 04:39:02.148434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Openstack-System-Scope: None Jun 01 04:39:02.148434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: User-Agent: python-urllib3/1.26.9 Jun 01 04:39:02.148434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Auth-Token: gAAAAABilusaiXdJqCNwqWQdT51DbPmRD8pAHbwXzV3-587Eryc6oQNrE2kDJqR5Zfdfd4dT29qb52XgUVUJF2T7sVG0r2SImbd24oNQxvNf2TJGfTjV3WSWKUwmSGPc1LymdmFN8eDVOZqJgg-NDvjYVD9HDPa-uaUVGSa_UtV3DhVH_VMssqM Jun 01 04:39:02.148434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Id: None Jun 01 04:39:02.148434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Name: None Jun 01 04:39:02.148434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Identity-Status: Confirmed Jun 01 04:39:02.148434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Is-Admin-Project: True Jun 01 04:39:02.148434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Id: default Jun 01 04:39:02.148434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Name: Default Jun 01 04:39:02.148434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Id: 89e9dc06c3304c42a7fb6cbed1e357a4 Jun 01 04:39:02.148434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Name: tempest-AttachVolumeTestJSON-1274552074 Jun 01 04:39:02.148434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Role: reader,member Jun 01 04:39:02.148434 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Roles: reader,member Jun 01 04:39:02.149918 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89e9dc06c3304c42a7fb6cbed1e357a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89e9dc06c3304c42a7fb6cbed1e357a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89e9dc06c3304c42a7fb6cbed1e357a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89e9dc06c3304c42a7fb6cbed1e357a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:39:02.149918 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant: tempest-AttachVolumeTestJSON-1274552074 Jun 01 04:39:02.149918 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Id: 89e9dc06c3304c42a7fb6cbed1e357a4 Jun 01 04:39:02.149918 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1274552074 Jun 01 04:39:02.149918 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User: tempest-AttachVolumeTestJSON-1274552074-project Jun 01 04:39:02.149918 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Id: default Jun 01 04:39:02.149918 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Name: Default Jun 01 04:39:02.149918 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Id: a0a147daff9846e699c26259fac4e004 Jun 01 04:39:02.149918 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Name: tempest-AttachVolumeTestJSON-1274552074-project Jun 01 04:39:02.149918 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: method: > Jun 01 04:39:02.149918 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: exception: Instance f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 could not be found. Jun 01 04:39:02.149918 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: action_args: {'id': 'f5d63ef9-2dd3-490e-8a17-895f7b2c3b95'} Jun 01 04:39:02.151651 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:39:02.151651 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:39:02.151651 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:39:02.151651 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:39:02.151651 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:39:02.151651 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:39:02.151651 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:39:02.151651 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:39:02.151651 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:39:02.151651 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:39:02.151651 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 could not be found. Jun 01 04:39:02.151651 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:39:02.151651 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:39:02.151651 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:39:02.151651 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:39:02.151651 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:39:02.151651 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:39:02.151651 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:39:02.151651 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:39:02.151651 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:39:02.153185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:39:02.153185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 01 04:39:02.153185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 01 04:39:02.153185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 01 04:39:02.153185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 01 04:39:02.153185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:39:02.153185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:39:02.153185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:39:02.153185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:39:02.153185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 could not be found. Jun 01 04:39:02.153185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:39:02.153185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:39:02.153185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:39:02.153185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:39:02.153185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:39:02.153185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:39:02.153185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:39:02.153185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:39:02.153185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 could not be found. Jun 01 04:39:02.153185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:39:02.154760 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-67a6be6d-323a-445d-a522-8116e386f2cb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Returning 404 to user: Instance f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 could not be found. {{(pid=118516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:39:02.154760 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-67a6be6d-323a-445d-a522-8116e386f2cb tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 404 len: 111 microversion: 2.1 time: 0.046883 Jun 01 04:39:02.154760 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 491/966] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 1 04:39:02 2022] DELETE /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:39:02.157959 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-1a454d78-fca6-4412-a549-0e72dd8f2fd6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:02.158572 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-1a454d78-fca6-4412-a549-0e72dd8f2fd6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] [instance: f5d63ef9-2dd3-490e-8a17-895f7b2c3b95] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:02.166251 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1a454d78-fca6-4412-a549-0e72dd8f2fd6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:02.166861 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1a454d78-fca6-4412-a549-0e72dd8f2fd6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:02.168265 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1a454d78-fca6-4412-a549-0e72dd8f2fd6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:02.169858 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1a454d78-fca6-4412-a549-0e72dd8f2fd6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:02.194976 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.wsgi [None req-1a454d78-fca6-4412-a549-0e72dd8f2fd6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] HTTP exception thrown: Instance f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 could not be found. Jun 01 04:39:02.196544 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-1a454d78-fca6-4412-a549-0e72dd8f2fd6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Request method failure captured: Jun 01 04:39:02.196544 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: request: GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 HTTP/1.1 Jun 01 04:39:02.196544 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept: application/json Jun 01 04:39:02.196544 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept-Encoding: identity Jun 01 04:39:02.196544 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Connection: close Jun 01 04:39:02.196544 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Length: 0 Jun 01 04:39:02.196544 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Type: application/json Jun 01 04:39:02.196544 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Host: 10.222.0.18 Jun 01 04:39:02.196544 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Openstack-System-Scope: None Jun 01 04:39:02.196544 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: User-Agent: python-urllib3/1.26.9 Jun 01 04:39:02.196544 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Auth-Token: gAAAAABilusaiXdJqCNwqWQdT51DbPmRD8pAHbwXzV3-587Eryc6oQNrE2kDJqR5Zfdfd4dT29qb52XgUVUJF2T7sVG0r2SImbd24oNQxvNf2TJGfTjV3WSWKUwmSGPc1LymdmFN8eDVOZqJgg-NDvjYVD9HDPa-uaUVGSa_UtV3DhVH_VMssqM Jun 01 04:39:02.196544 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Id: None Jun 01 04:39:02.196544 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Name: None Jun 01 04:39:02.196544 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Identity-Status: Confirmed Jun 01 04:39:02.196544 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Is-Admin-Project: True Jun 01 04:39:02.196544 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Id: default Jun 01 04:39:02.196544 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Name: Default Jun 01 04:39:02.196544 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Id: 89e9dc06c3304c42a7fb6cbed1e357a4 Jun 01 04:39:02.196544 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Name: tempest-AttachVolumeTestJSON-1274552074 Jun 01 04:39:02.196544 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Role: reader,member Jun 01 04:39:02.196544 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Roles: reader,member Jun 01 04:39:02.198719 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89e9dc06c3304c42a7fb6cbed1e357a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89e9dc06c3304c42a7fb6cbed1e357a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89e9dc06c3304c42a7fb6cbed1e357a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89e9dc06c3304c42a7fb6cbed1e357a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:39:02.198719 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant: tempest-AttachVolumeTestJSON-1274552074 Jun 01 04:39:02.198719 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Id: 89e9dc06c3304c42a7fb6cbed1e357a4 Jun 01 04:39:02.198719 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1274552074 Jun 01 04:39:02.198719 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User: tempest-AttachVolumeTestJSON-1274552074-project Jun 01 04:39:02.198719 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Id: default Jun 01 04:39:02.198719 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Name: Default Jun 01 04:39:02.198719 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Id: a0a147daff9846e699c26259fac4e004 Jun 01 04:39:02.198719 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Name: tempest-AttachVolumeTestJSON-1274552074-project Jun 01 04:39:02.198719 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: method: > Jun 01 04:39:02.198719 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: exception: Instance f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 could not be found. Jun 01 04:39:02.198719 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: action_args: {'id': 'f5d63ef9-2dd3-490e-8a17-895f7b2c3b95'} Jun 01 04:39:02.203968 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:39:02.203968 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:39:02.203968 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:39:02.203968 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:39:02.203968 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:39:02.203968 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:39:02.203968 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:39:02.203968 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:39:02.203968 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:39:02.203968 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:39:02.203968 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 could not be found. Jun 01 04:39:02.203968 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:39:02.203968 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:39:02.203968 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:39:02.203968 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:39:02.203968 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:39:02.203968 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:39:02.203968 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:39:02.203968 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:39:02.203968 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:39:02.205299 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:39:02.205299 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 01 04:39:02.205299 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 01 04:39:02.205299 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:39:02.205299 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:39:02.205299 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:39:02.205299 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:39:02.205299 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 could not be found. Jun 01 04:39:02.205299 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:39:02.205299 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:39:02.205299 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:39:02.205299 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:39:02.205299 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:39:02.205299 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:39:02.205299 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:39:02.205299 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:39:02.205299 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 could not be found. Jun 01 04:39:02.205299 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:39:02.206367 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-1a454d78-fca6-4412-a549-0e72dd8f2fd6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] Returning 404 to user: Instance f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 could not be found. {{(pid=118517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:39:02.206367 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-1a454d78-fca6-4412-a549-0e72dd8f2fd6 tempest-AttachVolumeTestJSON-1274552074 tempest-AttachVolumeTestJSON-1274552074-project] 10.222.0.18 "GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95" status: 404 len: 111 microversion: 2.1 time: 0.047526 Jun 01 04:39:02.206367 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 476/967] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:39:02 2022] GET /compute/v2.1/servers/f5d63ef9-2dd3-490e-8a17-895f7b2c3b95 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:39:16.684605 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:39:16.686877 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=48 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:39:16.810315 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-eb14f6d3-dd45-42e2-8b26-a7da42023fb1 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Action: 'create', calling method: .version_select at 0x7ff325ad6310>, body: {"keypair": {"name": "tempest-keypair-1397796552", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXIgNQFLHrE4lB19Uf/mSOdP5DHIACM+9aBnq5+JxjPXqqs2OI79uAqcxfeeN6XVlY17OTm4GjMwVIzYB/NjG66K3LdemhpIZH4jAlO7L4DwZoeEHRkO7d/8Vvpb0entg=="}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:39:16.826229 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-eb14f6d3-dd45-42e2-8b26-a7da42023fb1 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Getting quotas for project 756cb4ed8d2345dcaae27638b257a480. Resources: {'key_pairs'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:39:16.831596 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-eb14f6d3-dd45-42e2-8b26-a7da42023fb1 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Getting quotas for user a17f39a1626d45299666f43be4ffc3ec and project 756cb4ed8d2345dcaae27638b257a480. Resources: {'key_pairs'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:39:16.934322 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-eb14f6d3-dd45-42e2-8b26-a7da42023fb1 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.256496 Jun 01 04:39:16.935176 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 492/968] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jun 1 04:39:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:39:20.406847 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-132468e5-e263-40d1-a91d-dd9d601c1b97 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-255706125", "imageRef": "14321baa-3ac5-4c53-8054-4945abce5b2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8715975b-1e98-4a30-82e5-baf5c981e463"}], "security_groups": [{"name": "tempest-securitygroup--148055132"}], "key_name": "tempest-keypair-1397796552", "user_data": "}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:39:20.427685 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:39:20.428768 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=48,nova_cell1:UPDATE=1 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:39:20.557435 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.network.neutron [None req-132468e5-e263-40d1-a91d-dd9d601c1b97 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] validate_networks() for [('8715975b-1e98-4a30-82e5-baf5c981e463', None, None, None, None, None)] {{(pid=118517) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 01 04:39:20.952985 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-132468e5-e263-40d1-a91d-dd9d601c1b97 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Flavor limits 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 01 04:39:20.953428 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-132468e5-e263-40d1-a91d-dd9d601c1b97 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Image limits 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 01 04:39:20.953882 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-132468e5-e263-40d1-a91d-dd9d601c1b97 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Flavor pref 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 01 04:39:20.954298 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-132468e5-e263-40d1-a91d-dd9d601c1b97 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Image pref 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 01 04:39:20.954709 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-132468e5-e263-40d1-a91d-dd9d601c1b97 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 01 04:39:20.963920 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-132468e5-e263-40d1-a91d-dd9d601c1b97 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:20.964363 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-132468e5-e263-40d1-a91d-dd9d601c1b97 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:20.965181 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-132468e5-e263-40d1-a91d-dd9d601c1b97 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:20.965623 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-132468e5-e263-40d1-a91d-dd9d601c1b97 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:20.982895 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.quota [None req-132468e5-e263-40d1-a91d-dd9d601c1b97 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Getting quotas for project 756cb4ed8d2345dcaae27638b257a480. Resources: {'ram', 'instances', 'cores'} {{(pid=118517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:39:20.987024 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.quota [None req-132468e5-e263-40d1-a91d-dd9d601c1b97 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Getting quotas for user a17f39a1626d45299666f43be4ffc3ec and project 756cb4ed8d2345dcaae27638b257a480. Resources: {'ram', 'instances', 'cores'} {{(pid=118517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:39:21.001208 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-132468e5-e263-40d1-a91d-dd9d601c1b97 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Going to run 1 instances... {{(pid=118517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 01 04:39:21.003550 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-132468e5-e263-40d1-a91d-dd9d601c1b97 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 51a21959-da2d-4c3c-8b95-02847c3cf58a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14321baa-3ac5-4c53-8054-4945abce5b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 01 04:39:21.169457 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-132468e5-e263-40d1-a91d-dd9d601c1b97 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.770279 Jun 01 04:39:21.170271 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 477/969] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 1 04:39:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 01 04:39:21.183193 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-7c6ee5b5-f017-4d62-993f-beff4ba69c32 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:21.184524 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-7c6ee5b5-f017-4d62-993f-beff4ba69c32 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 51a21959-da2d-4c3c-8b95-02847c3cf58a] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:21.279195 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-7c6ee5b5-f017-4d62-993f-beff4ba69c32 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:39:21.288874 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-7c6ee5b5-f017-4d62-993f-beff4ba69c32 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a" status: 200 len: 1241 microversion: 2.1 time: 0.110542 Jun 01 04:39:21.294848 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 493/970] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:39:21 2022] GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a => generated 1241 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:39:22.307790 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-6dfb6e6d-1f6f-43b2-8713-faa7baddf817 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:22.309612 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-6dfb6e6d-1f6f-43b2-8713-faa7baddf817 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 51a21959-da2d-4c3c-8b95-02847c3cf58a] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:22.394853 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-6dfb6e6d-1f6f-43b2-8713-faa7baddf817 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:39:22.404283 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-6dfb6e6d-1f6f-43b2-8713-faa7baddf817 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a" status: 200 len: 1241 microversion: 2.1 time: 0.101974 Jun 01 04:39:22.405182 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 478/971] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:39:22 2022] GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a => generated 1241 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:39:23.421506 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-91d7bed9-9886-4ee2-a0eb-6f5e4f2a12e4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:23.422228 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-91d7bed9-9886-4ee2-a0eb-6f5e4f2a12e4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 51a21959-da2d-4c3c-8b95-02847c3cf58a] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:23.445507 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-91d7bed9-9886-4ee2-a0eb-6f5e4f2a12e4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:23.445507 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-91d7bed9-9886-4ee2-a0eb-6f5e4f2a12e4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:23.445507 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-91d7bed9-9886-4ee2-a0eb-6f5e4f2a12e4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:23.447394 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-91d7bed9-9886-4ee2-a0eb-6f5e4f2a12e4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:23.554601 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-91d7bed9-9886-4ee2-a0eb-6f5e4f2a12e4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:39:23.564069 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-91d7bed9-9886-4ee2-a0eb-6f5e4f2a12e4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a" status: 200 len: 1293 microversion: 2.1 time: 0.146753 Jun 01 04:39:23.574382 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 494/972] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:39:23 2022] GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a => generated 1293 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:39:24.586473 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-479fffee-c655-4e94-bcba-5bb3dd4ff6c7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:24.587795 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-479fffee-c655-4e94-bcba-5bb3dd4ff6c7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 51a21959-da2d-4c3c-8b95-02847c3cf58a] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:24.595832 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-479fffee-c655-4e94-bcba-5bb3dd4ff6c7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:24.596907 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-479fffee-c655-4e94-bcba-5bb3dd4ff6c7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:24.598622 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-479fffee-c655-4e94-bcba-5bb3dd4ff6c7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:24.599275 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-479fffee-c655-4e94-bcba-5bb3dd4ff6c7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:24.751293 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-479fffee-c655-4e94-bcba-5bb3dd4ff6c7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:39:24.763670 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-479fffee-c655-4e94-bcba-5bb3dd4ff6c7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a" status: 200 len: 1299 microversion: 2.1 time: 0.179458 Jun 01 04:39:24.774931 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 479/973] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:39:24 2022] GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a => generated 1299 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:39:25.791775 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-0ddc86b2-8a78-4fe5-9fc0-766628dae112 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:25.792599 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-0ddc86b2-8a78-4fe5-9fc0-766628dae112 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 51a21959-da2d-4c3c-8b95-02847c3cf58a] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:25.829474 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0ddc86b2-8a78-4fe5-9fc0-766628dae112 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:25.830487 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0ddc86b2-8a78-4fe5-9fc0-766628dae112 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:25.837076 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0ddc86b2-8a78-4fe5-9fc0-766628dae112 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:25.840875 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0ddc86b2-8a78-4fe5-9fc0-766628dae112 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:26.207394 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-0ddc86b2-8a78-4fe5-9fc0-766628dae112 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:39:26.222073 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-0ddc86b2-8a78-4fe5-9fc0-766628dae112 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a" status: 200 len: 1366 microversion: 2.1 time: 0.435295 Jun 01 04:39:26.234976 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 495/974] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:39:25 2022] GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a => generated 1366 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:39:27.250167 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-108666bd-b3ce-469f-a769-36751a3cc147 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:27.250787 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-108666bd-b3ce-469f-a769-36751a3cc147 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 51a21959-da2d-4c3c-8b95-02847c3cf58a] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:27.258479 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-108666bd-b3ce-469f-a769-36751a3cc147 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:27.261932 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-108666bd-b3ce-469f-a769-36751a3cc147 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:27.266329 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-108666bd-b3ce-469f-a769-36751a3cc147 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:27.266984 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-108666bd-b3ce-469f-a769-36751a3cc147 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:27.397344 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-10d622d5-5eac-4336-bb27-fbeb80f25057 req-cc866ef1-62e7-4e91-8096-434e103a1308 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51a21959-da2d-4c3c-8b95-02847c3cf58a", "tag": "0a53c886-36f8-4ef1-a236-0be39e1c7bc4"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:39:27.417756 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-10d622d5-5eac-4336-bb27-fbeb80f25057 req-cc866ef1-62e7-4e91-8096-434e103a1308 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:27.418219 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-10d622d5-5eac-4336-bb27-fbeb80f25057 req-cc866ef1-62e7-4e91-8096-434e103a1308 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:27.454817 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-10d622d5-5eac-4336-bb27-fbeb80f25057 req-cc866ef1-62e7-4e91-8096-434e103a1308 service nova] Creating event network-changed:0a53c886-36f8-4ef1-a236-0be39e1c7bc4 for instance 51a21959-da2d-4c3c-8b95-02847c3cf58a on hv-cinder-66710 Jun 01 04:39:27.472626 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-10d622d5-5eac-4336-bb27-fbeb80f25057 req-cc866ef1-62e7-4e91-8096-434e103a1308 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072895 Jun 01 04:39:27.472626 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 496/975] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:39:27.608837 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-108666bd-b3ce-469f-a769-36751a3cc147 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:39:27.630751 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-108666bd-b3ce-469f-a769-36751a3cc147 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a" status: 200 len: 1366 microversion: 2.1 time: 0.384317 Jun 01 04:39:27.632216 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 480/976] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:39:27 2022] GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a => generated 1366 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:39:27.834526 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-c1ea2bb7-5672-4899-8703-db38cb36eae6 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Action: 'create', calling method: .version_select at 0x7ff325b933a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1065823219", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJzDz8QIQ1UUsfkxDYyrlhfllJRBCwRzdIdum3Pi1Gw4O1A5MbGFgsg9uoBGTcs96dLofvewJ9jwyU+2iFku1YldIBSoJcjFJwlUEKlTRRhRScvdjs+0ybglKGBYn/kCQ=="}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:39:27.863188 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-c1ea2bb7-5672-4899-8703-db38cb36eae6 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Getting quotas for project 6d70e82d96624016bed251b30b26ad73. Resources: {'key_pairs'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:39:27.868228 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-c1ea2bb7-5672-4899-8703-db38cb36eae6 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Getting quotas for user 44b4ed73a96143098d2c64384233d539 and project 6d70e82d96624016bed251b30b26ad73. Resources: {'key_pairs'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:39:28.041692 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-c1ea2bb7-5672-4899-8703-db38cb36eae6 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.525063 Jun 01 04:39:28.042612 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 497/977] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jun 1 04:39:27 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:39:28.648462 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-0553be8a-7382-42f5-a770-96fd87731ef0 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:28.649115 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-0553be8a-7382-42f5-a770-96fd87731ef0 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 51a21959-da2d-4c3c-8b95-02847c3cf58a] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:28.656569 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0553be8a-7382-42f5-a770-96fd87731ef0 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:28.657108 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0553be8a-7382-42f5-a770-96fd87731ef0 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:28.657998 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0553be8a-7382-42f5-a770-96fd87731ef0 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:28.658475 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0553be8a-7382-42f5-a770-96fd87731ef0 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:28.815078 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-0553be8a-7382-42f5-a770-96fd87731ef0 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:39:28.823230 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-0553be8a-7382-42f5-a770-96fd87731ef0 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a" status: 200 len: 1366 microversion: 2.1 time: 0.179537 Jun 01 04:39:28.823831 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 481/978] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:39:28 2022] GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:39:29.841494 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-a08626cb-d3b2-48b0-acc0-09de8793cc3c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:29.842324 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-a08626cb-d3b2-48b0-acc0-09de8793cc3c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 51a21959-da2d-4c3c-8b95-02847c3cf58a] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:29.849168 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a08626cb-d3b2-48b0-acc0-09de8793cc3c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:29.849620 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a08626cb-d3b2-48b0-acc0-09de8793cc3c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:29.850385 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a08626cb-d3b2-48b0-acc0-09de8793cc3c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:29.850820 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a08626cb-d3b2-48b0-acc0-09de8793cc3c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:30.038088 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-a08626cb-d3b2-48b0-acc0-09de8793cc3c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:39:30.046188 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-a08626cb-d3b2-48b0-acc0-09de8793cc3c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a" status: 200 len: 1366 microversion: 2.1 time: 0.209988 Jun 01 04:39:30.046769 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 498/979] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:39:29 2022] GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:39:31.064959 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-78f2c7cc-f409-4e83-b61d-9e50fca4a5b3 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:31.066179 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-78f2c7cc-f409-4e83-b61d-9e50fca4a5b3 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 51a21959-da2d-4c3c-8b95-02847c3cf58a] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:31.069068 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell0:SELECT=2 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:39:31.075610 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-78f2c7cc-f409-4e83-b61d-9e50fca4a5b3 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:31.085449 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-78f2c7cc-f409-4e83-b61d-9e50fca4a5b3 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:31.086465 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-78f2c7cc-f409-4e83-b61d-9e50fca4a5b3 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:31.087057 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-78f2c7cc-f409-4e83-b61d-9e50fca4a5b3 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:31.238959 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-78f2c7cc-f409-4e83-b61d-9e50fca4a5b3 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:39:31.247442 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-78f2c7cc-f409-4e83-b61d-9e50fca4a5b3 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a" status: 200 len: 1366 microversion: 2.1 time: 0.187464 Jun 01 04:39:31.248015 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 482/980] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:39:31 2022] GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:39:32.270114 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-41ba36f2-6a3b-4925-9a64-81005a1b2caf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:32.272917 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-41ba36f2-6a3b-4925-9a64-81005a1b2caf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 51a21959-da2d-4c3c-8b95-02847c3cf58a] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:32.281335 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-41ba36f2-6a3b-4925-9a64-81005a1b2caf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:32.281787 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-41ba36f2-6a3b-4925-9a64-81005a1b2caf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:32.282619 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-41ba36f2-6a3b-4925-9a64-81005a1b2caf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:32.283063 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-41ba36f2-6a3b-4925-9a64-81005a1b2caf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:32.443482 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-41ba36f2-6a3b-4925-9a64-81005a1b2caf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:39:32.451258 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-41ba36f2-6a3b-4925-9a64-81005a1b2caf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a" status: 200 len: 1366 microversion: 2.1 time: 0.186558 Jun 01 04:39:32.451860 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 499/981] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:39:32 2022] GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:39:33.211147 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell0:SELECT=8 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:39:33.284472 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-5b64414d-28f9-455b-bfe9-61fbd5bf512b req-5af03242-2a31-48d6-9d9c-771cf9545c60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51a21959-da2d-4c3c-8b95-02847c3cf58a", "name": "network-vif-plugged", "status": "completed", "tag": "0a53c886-36f8-4ef1-a236-0be39e1c7bc4"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:39:33.293016 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-5b64414d-28f9-455b-bfe9-61fbd5bf512b req-5af03242-2a31-48d6-9d9c-771cf9545c60 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:33.293562 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-5b64414d-28f9-455b-bfe9-61fbd5bf512b req-5af03242-2a31-48d6-9d9c-771cf9545c60 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:33.307219 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-5b64414d-28f9-455b-bfe9-61fbd5bf512b req-5af03242-2a31-48d6-9d9c-771cf9545c60 service nova] Creating event network-vif-plugged:0a53c886-36f8-4ef1-a236-0be39e1c7bc4 for instance 51a21959-da2d-4c3c-8b95-02847c3cf58a on hv-cinder-66710 Jun 01 04:39:33.312548 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-5b64414d-28f9-455b-bfe9-61fbd5bf512b req-5af03242-2a31-48d6-9d9c-771cf9545c60 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102530 Jun 01 04:39:33.313362 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 483/982] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:39:33.468622 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-7e46174d-0bed-4537-bc52-27816e6d861d tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:33.469255 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-7e46174d-0bed-4537-bc52-27816e6d861d tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 51a21959-da2d-4c3c-8b95-02847c3cf58a] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:33.475841 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7e46174d-0bed-4537-bc52-27816e6d861d tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:33.476284 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7e46174d-0bed-4537-bc52-27816e6d861d tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:33.477053 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7e46174d-0bed-4537-bc52-27816e6d861d tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:33.477490 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7e46174d-0bed-4537-bc52-27816e6d861d tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:33.651017 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-7e46174d-0bed-4537-bc52-27816e6d861d tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:39:33.684588 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-7e46174d-0bed-4537-bc52-27816e6d861d tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a" status: 200 len: 1366 microversion: 2.1 time: 0.220825 Jun 01 04:39:33.685181 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 500/983] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:39:33 2022] GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:39:34.702378 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-cceb1edc-8de7-4b59-a857-c27ff8cec748 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:34.703068 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-cceb1edc-8de7-4b59-a857-c27ff8cec748 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 51a21959-da2d-4c3c-8b95-02847c3cf58a] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:34.709653 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-cceb1edc-8de7-4b59-a857-c27ff8cec748 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:34.710096 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-cceb1edc-8de7-4b59-a857-c27ff8cec748 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:34.710851 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-cceb1edc-8de7-4b59-a857-c27ff8cec748 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:34.711282 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-cceb1edc-8de7-4b59-a857-c27ff8cec748 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:34.843073 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-cceb1edc-8de7-4b59-a857-c27ff8cec748 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:39:34.850785 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-cceb1edc-8de7-4b59-a857-c27ff8cec748 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a" status: 200 len: 1366 microversion: 2.1 time: 0.153052 Jun 01 04:39:34.851947 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 484/984] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:39:34 2022] GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:39:35.868684 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-6fd73e71-13fa-4b23-9ece-8130fea24e3b tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:35.869334 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-6fd73e71-13fa-4b23-9ece-8130fea24e3b tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 51a21959-da2d-4c3c-8b95-02847c3cf58a] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:35.875630 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6fd73e71-13fa-4b23-9ece-8130fea24e3b tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:35.876083 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6fd73e71-13fa-4b23-9ece-8130fea24e3b tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:35.876849 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6fd73e71-13fa-4b23-9ece-8130fea24e3b tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:35.877292 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6fd73e71-13fa-4b23-9ece-8130fea24e3b tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:36.014166 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-6fd73e71-13fa-4b23-9ece-8130fea24e3b tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:39:36.021936 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-6fd73e71-13fa-4b23-9ece-8130fea24e3b tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a" status: 200 len: 1555 microversion: 2.1 time: 0.157250 Jun 01 04:39:36.022797 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 501/985] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:39:35 2022] GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:39:36.039783 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-72f1fe6a-699a-4558-a8e0-7e7d978aaa02 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:36.040383 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-72f1fe6a-699a-4558-a8e0-7e7d978aaa02 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 51a21959-da2d-4c3c-8b95-02847c3cf58a] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:36.046515 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-72f1fe6a-699a-4558-a8e0-7e7d978aaa02 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:36.046965 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-72f1fe6a-699a-4558-a8e0-7e7d978aaa02 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:36.047774 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-72f1fe6a-699a-4558-a8e0-7e7d978aaa02 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:36.048214 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-72f1fe6a-699a-4558-a8e0-7e7d978aaa02 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:36.124754 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-72f1fe6a-699a-4558-a8e0-7e7d978aaa02 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089150 Jun 01 04:39:36.125555 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 485/986] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Jun 1 04:39:36 2022] GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:39:37.439520 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-7ccd5ef2-2c21-4a4d-a3f5-4ad971d9e86b req-ebc1cb61-4054-49c5-aa65-334ed43f7b59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51a21959-da2d-4c3c-8b95-02847c3cf58a", "tag": "0a53c886-36f8-4ef1-a236-0be39e1c7bc4"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:39:37.448357 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-7ccd5ef2-2c21-4a4d-a3f5-4ad971d9e86b req-ebc1cb61-4054-49c5-aa65-334ed43f7b59 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:37.448815 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-7ccd5ef2-2c21-4a4d-a3f5-4ad971d9e86b req-ebc1cb61-4054-49c5-aa65-334ed43f7b59 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:37.459972 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-7ccd5ef2-2c21-4a4d-a3f5-4ad971d9e86b req-ebc1cb61-4054-49c5-aa65-334ed43f7b59 service nova] Creating event network-changed:0a53c886-36f8-4ef1-a236-0be39e1c7bc4 for instance 51a21959-da2d-4c3c-8b95-02847c3cf58a on hv-cinder-66710 Jun 01 04:39:37.465432 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-7ccd5ef2-2c21-4a4d-a3f5-4ad971d9e86b req-ebc1cb61-4054-49c5-aa65-334ed43f7b59 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030009 Jun 01 04:39:37.466030 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 502/987] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:39:46.164228 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:39:46.165373 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=38 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:39:46.169332 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-30d5d90b-984a-4d9a-a080-9da4622cafe0 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-772437277", "imageRef": "14321baa-3ac5-4c53-8054-4945abce5b2d", "flavorRef": "452", "networks": [{"uuid": "38efa17b-6b81-41c1-9aa7-2e9653e0399f"}]}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:39:46.236412 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.network.neutron [None req-30d5d90b-984a-4d9a-a080-9da4622cafe0 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] validate_networks() for [('38efa17b-6b81-41c1-9aa7-2e9653e0399f', None, None, None, None, None)] {{(pid=118517) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 01 04:39:46.619552 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-30d5d90b-984a-4d9a-a080-9da4622cafe0 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Flavor limits 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 01 04:39:46.619972 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-30d5d90b-984a-4d9a-a080-9da4622cafe0 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Image limits 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 01 04:39:46.620442 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-30d5d90b-984a-4d9a-a080-9da4622cafe0 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Flavor pref 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 01 04:39:46.620847 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-30d5d90b-984a-4d9a-a080-9da4622cafe0 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Image pref 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 01 04:39:46.621264 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-30d5d90b-984a-4d9a-a080-9da4622cafe0 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 01 04:39:46.630864 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-30d5d90b-984a-4d9a-a080-9da4622cafe0 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:46.631325 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-30d5d90b-984a-4d9a-a080-9da4622cafe0 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:46.632155 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-30d5d90b-984a-4d9a-a080-9da4622cafe0 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:46.632584 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-30d5d90b-984a-4d9a-a080-9da4622cafe0 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:46.649272 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.quota [None req-30d5d90b-984a-4d9a-a080-9da4622cafe0 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Getting quotas for project 6607408c2a46439d93026002d312b9de. Resources: {'ram', 'instances', 'cores'} {{(pid=118517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:39:46.653821 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.quota [None req-30d5d90b-984a-4d9a-a080-9da4622cafe0 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Getting quotas for user 80b97ad4fa674391a99cf97bc10da8bc and project 6607408c2a46439d93026002d312b9de. Resources: {'ram', 'instances', 'cores'} {{(pid=118517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:39:46.664552 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-30d5d90b-984a-4d9a-a080-9da4622cafe0 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Going to run 1 instances... {{(pid=118517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 01 04:39:46.666809 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-30d5d90b-984a-4d9a-a080-9da4622cafe0 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: 4ab8a205-6fc8-4072-bd7b-f363a9d3740d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14321baa-3ac5-4c53-8054-4945abce5b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 01 04:39:46.778993 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-30d5d90b-984a-4d9a-a080-9da4622cafe0 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.616313 Jun 01 04:39:46.779674 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 486/988] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 1 04:39:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 01 04:39:46.786858 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell0:SELECT=10 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:39:46.791921 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-1e9870e3-7651-4bb5-9084-b6111ebcf1c9 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:46.792832 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-1e9870e3-7651-4bb5-9084-b6111ebcf1c9 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: 4ab8a205-6fc8-4072-bd7b-f363a9d3740d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:46.850180 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-1e9870e3-7651-4bb5-9084-b6111ebcf1c9 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:39:46.857845 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-1e9870e3-7651-4bb5-9084-b6111ebcf1c9 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d" status: 200 len: 1213 microversion: 2.1 time: 0.071660 Jun 01 04:39:46.858238 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 503/989] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:39:46 2022] GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:39:47.874580 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-0ba2a467-5327-4c8a-bc7e-f09f9bf97383 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:47.875187 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-0ba2a467-5327-4c8a-bc7e-f09f9bf97383 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: 4ab8a205-6fc8-4072-bd7b-f363a9d3740d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:47.881944 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0ba2a467-5327-4c8a-bc7e-f09f9bf97383 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:47.882394 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0ba2a467-5327-4c8a-bc7e-f09f9bf97383 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:47.883158 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0ba2a467-5327-4c8a-bc7e-f09f9bf97383 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:47.884145 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0ba2a467-5327-4c8a-bc7e-f09f9bf97383 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:47.945981 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-0ba2a467-5327-4c8a-bc7e-f09f9bf97383 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:39:47.954043 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-0ba2a467-5327-4c8a-bc7e-f09f9bf97383 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d" status: 200 len: 1217 microversion: 2.1 time: 0.083945 Jun 01 04:39:47.954606 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 487/990] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:39:47 2022] GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:39:48.971263 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-1b08a3bb-81cc-4f6a-87e7-8de5111c84f7 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:48.971904 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-1b08a3bb-81cc-4f6a-87e7-8de5111c84f7 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: 4ab8a205-6fc8-4072-bd7b-f363a9d3740d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:48.973862 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=40 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:39:48.980045 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1b08a3bb-81cc-4f6a-87e7-8de5111c84f7 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:48.980501 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1b08a3bb-81cc-4f6a-87e7-8de5111c84f7 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:48.981755 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1b08a3bb-81cc-4f6a-87e7-8de5111c84f7 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:48.982201 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1b08a3bb-81cc-4f6a-87e7-8de5111c84f7 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:49.060743 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-1b08a3bb-81cc-4f6a-87e7-8de5111c84f7 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:39:49.068388 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-1b08a3bb-81cc-4f6a-87e7-8de5111c84f7 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d" status: 200 len: 1273 microversion: 2.1 time: 0.101092 Jun 01 04:39:49.068945 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 504/991] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:39:48 2022] GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d => generated 1273 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:39:50.085475 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a99a7286-7a99-4b85-9ed0-154c112a52ad tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:50.086352 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-a99a7286-7a99-4b85-9ed0-154c112a52ad tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: 4ab8a205-6fc8-4072-bd7b-f363a9d3740d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:50.092693 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a99a7286-7a99-4b85-9ed0-154c112a52ad tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:50.093140 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a99a7286-7a99-4b85-9ed0-154c112a52ad tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:50.093908 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a99a7286-7a99-4b85-9ed0-154c112a52ad tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:50.094341 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a99a7286-7a99-4b85-9ed0-154c112a52ad tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:50.228361 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-a99a7286-7a99-4b85-9ed0-154c112a52ad tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:39:50.236325 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-a99a7286-7a99-4b85-9ed0-154c112a52ad tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d" status: 200 len: 1313 microversion: 2.1 time: 0.154714 Jun 01 04:39:50.236894 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 488/992] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:39:50 2022] GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:39:50.589381 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-05b97315-8af5-4033-9097-87acf8793b03 req-b114d14e-4550-4fef-9edf-92c102146cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ab8a205-6fc8-4072-bd7b-f363a9d3740d", "tag": "5e7dd023-8558-49bd-b4eb-7df1c5bd51ce"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:39:50.598175 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-05b97315-8af5-4033-9097-87acf8793b03 req-b114d14e-4550-4fef-9edf-92c102146cb0 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:50.604367 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-05b97315-8af5-4033-9097-87acf8793b03 req-b114d14e-4550-4fef-9edf-92c102146cb0 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:50.613938 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-05b97315-8af5-4033-9097-87acf8793b03 req-b114d14e-4550-4fef-9edf-92c102146cb0 service nova] Creating event network-changed:5e7dd023-8558-49bd-b4eb-7df1c5bd51ce for instance 4ab8a205-6fc8-4072-bd7b-f363a9d3740d on hv-cinder-66710 Jun 01 04:39:50.619069 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-05b97315-8af5-4033-9097-87acf8793b03 req-b114d14e-4550-4fef-9edf-92c102146cb0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040795 Jun 01 04:39:50.619711 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 505/993] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:39:51.254019 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-62e7c395-65ed-4cde-acb4-6db401e22507 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:51.254754 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-62e7c395-65ed-4cde-acb4-6db401e22507 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: 4ab8a205-6fc8-4072-bd7b-f363a9d3740d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:51.262055 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-62e7c395-65ed-4cde-acb4-6db401e22507 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:51.262512 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-62e7c395-65ed-4cde-acb4-6db401e22507 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:51.263319 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-62e7c395-65ed-4cde-acb4-6db401e22507 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:51.263770 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-62e7c395-65ed-4cde-acb4-6db401e22507 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:51.396271 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-62e7c395-65ed-4cde-acb4-6db401e22507 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:39:51.404003 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-62e7c395-65ed-4cde-acb4-6db401e22507 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d" status: 200 len: 1313 microversion: 2.1 time: 0.153798 Jun 01 04:39:51.404699 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 489/994] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:39:51 2022] GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:39:52.422313 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-1d53ddb9-2c2d-42b9-90c7-3c9906033aea tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:52.423150 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-1d53ddb9-2c2d-42b9-90c7-3c9906033aea tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: 4ab8a205-6fc8-4072-bd7b-f363a9d3740d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:52.429400 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1d53ddb9-2c2d-42b9-90c7-3c9906033aea tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:52.429845 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1d53ddb9-2c2d-42b9-90c7-3c9906033aea tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:52.431232 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1d53ddb9-2c2d-42b9-90c7-3c9906033aea tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:52.431696 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1d53ddb9-2c2d-42b9-90c7-3c9906033aea tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:52.561417 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-1d53ddb9-2c2d-42b9-90c7-3c9906033aea tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:39:52.568929 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-1d53ddb9-2c2d-42b9-90c7-3c9906033aea tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d" status: 200 len: 1313 microversion: 2.1 time: 0.151271 Jun 01 04:39:52.569499 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 506/995] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:39:52 2022] GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:39:53.585735 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-b1298073-869d-4cea-b660-afced6c5ab17 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:53.586345 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-b1298073-869d-4cea-b660-afced6c5ab17 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: 4ab8a205-6fc8-4072-bd7b-f363a9d3740d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:53.592833 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b1298073-869d-4cea-b660-afced6c5ab17 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:53.593283 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b1298073-869d-4cea-b660-afced6c5ab17 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:53.594049 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b1298073-869d-4cea-b660-afced6c5ab17 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:53.594485 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b1298073-869d-4cea-b660-afced6c5ab17 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:53.727360 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-b1298073-869d-4cea-b660-afced6c5ab17 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:39:53.733276 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-a9d1795f-8069-4443-88dc-57ba85f19b99 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-903722773", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1065823219", "security_groups": [{"name": "tempest-secgroup-smoke-750034705"}], "networks": [{"uuid": "0eb7aa87-104e-4cc4-8db4-35ae245f39f5"}], "block_device_mapping_v2": [{"uuid": "2ff304cc-7edf-4055-b97c-a55ba474e0ff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:39:53.739924 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-b1298073-869d-4cea-b660-afced6c5ab17 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d" status: 200 len: 1313 microversion: 2.1 time: 0.157688 Jun 01 04:39:53.741055 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 490/996] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:39:53 2022] GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:39:53.853020 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.network.neutron [None req-a9d1795f-8069-4443-88dc-57ba85f19b99 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] validate_networks() for [('0eb7aa87-104e-4cc4-8db4-35ae245f39f5', None, None, None, None, None)] {{(pid=118516) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 01 04:39:54.283396 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-a9d1795f-8069-4443-88dc-57ba85f19b99 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Flavor limits 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 01 04:39:54.283822 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-a9d1795f-8069-4443-88dc-57ba85f19b99 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Image limits 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 01 04:39:54.284293 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-a9d1795f-8069-4443-88dc-57ba85f19b99 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Flavor pref 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 01 04:39:54.284695 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-a9d1795f-8069-4443-88dc-57ba85f19b99 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Image pref 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 01 04:39:54.285105 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-a9d1795f-8069-4443-88dc-57ba85f19b99 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 01 04:39:54.294756 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a9d1795f-8069-4443-88dc-57ba85f19b99 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:54.301763 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a9d1795f-8069-4443-88dc-57ba85f19b99 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:54.301763 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a9d1795f-8069-4443-88dc-57ba85f19b99 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:54.301763 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a9d1795f-8069-4443-88dc-57ba85f19b99 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:54.313302 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-a9d1795f-8069-4443-88dc-57ba85f19b99 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Getting quotas for project 6d70e82d96624016bed251b30b26ad73. Resources: {'ram', 'instances', 'cores'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:39:54.317192 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-a9d1795f-8069-4443-88dc-57ba85f19b99 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Getting quotas for user 44b4ed73a96143098d2c64384233d539 and project 6d70e82d96624016bed251b30b26ad73. Resources: {'ram', 'instances', 'cores'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:39:54.374558 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-a9d1795f-8069-4443-88dc-57ba85f19b99 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Going to run 1 instances... {{(pid=118516) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 01 04:39:54.376818 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-a9d1795f-8069-4443-88dc-57ba85f19b99 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2ff304cc-7edf-4055-b97c-a55ba474e0ff',volume_size=None,volume_type=None)] {{(pid=118516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 01 04:39:54.757997 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-062003f6-b427-4af5-90a2-4a2428eaffa5 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:54.758617 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-062003f6-b427-4af5-90a2-4a2428eaffa5 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: 4ab8a205-6fc8-4072-bd7b-f363a9d3740d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:54.765315 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-062003f6-b427-4af5-90a2-4a2428eaffa5 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:54.765751 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-062003f6-b427-4af5-90a2-4a2428eaffa5 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:54.766523 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-062003f6-b427-4af5-90a2-4a2428eaffa5 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:54.766954 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-062003f6-b427-4af5-90a2-4a2428eaffa5 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:54.836442 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-a9d1795f-8069-4443-88dc-57ba85f19b99 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.110347 Jun 01 04:39:54.838016 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 507/997] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 1 04:39:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 1113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 01 04:39:54.848015 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-a02cbc3b-f67f-4209-abc5-711f2cad0f5f tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:54.848906 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-a02cbc3b-f67f-4209-abc5-711f2cad0f5f tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:54.908469 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-a02cbc3b-f67f-4209-abc5-711f2cad0f5f tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:39:54.918689 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-a02cbc3b-f67f-4209-abc5-711f2cad0f5f tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1088 microversion: 2.1 time: 0.074435 Jun 01 04:39:54.919609 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 508/998] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:39:54 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1088 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:39:54.922935 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-062003f6-b427-4af5-90a2-4a2428eaffa5 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:39:54.932992 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-062003f6-b427-4af5-90a2-4a2428eaffa5 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d" status: 200 len: 1313 microversion: 2.1 time: 0.178643 Jun 01 04:39:54.933697 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 491/999] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:39:54 2022] GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:39:55.936654 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-4c08081a-7b2b-47a3-9742-5f385a17327e tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:55.937234 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-4c08081a-7b2b-47a3-9742-5f385a17327e tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:55.939557 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=5 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:39:55.945294 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4c08081a-7b2b-47a3-9742-5f385a17327e tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:55.945294 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4c08081a-7b2b-47a3-9742-5f385a17327e tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:55.945586 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4c08081a-7b2b-47a3-9742-5f385a17327e tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:55.946721 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4c08081a-7b2b-47a3-9742-5f385a17327e tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:55.950094 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-2fb87392-a3cf-40ac-843f-b3823341df50 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:55.950729 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-2fb87392-a3cf-40ac-843f-b3823341df50 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: 4ab8a205-6fc8-4072-bd7b-f363a9d3740d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:55.957144 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2fb87392-a3cf-40ac-843f-b3823341df50 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:55.957684 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2fb87392-a3cf-40ac-843f-b3823341df50 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:55.958466 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2fb87392-a3cf-40ac-843f-b3823341df50 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:55.958909 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2fb87392-a3cf-40ac-843f-b3823341df50 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:56.017237 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-4c08081a-7b2b-47a3-9742-5f385a17327e tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:39:56.025093 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-4c08081a-7b2b-47a3-9742-5f385a17327e tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1138 microversion: 2.1 time: 0.092338 Jun 01 04:39:56.025676 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 509/1000] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:39:55 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1138 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:39:56.104531 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-2fb87392-a3cf-40ac-843f-b3823341df50 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:39:56.112310 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-2fb87392-a3cf-40ac-843f-b3823341df50 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d" status: 200 len: 1313 microversion: 2.1 time: 0.166738 Jun 01 04:39:56.112880 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 492/1001] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:39:55 2022] GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:39:57.042414 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-45a4b415-d164-4fb7-80bf-bb6aea000362 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:57.043160 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-45a4b415-d164-4fb7-80bf-bb6aea000362 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:57.049701 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-45a4b415-d164-4fb7-80bf-bb6aea000362 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:57.050155 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-45a4b415-d164-4fb7-80bf-bb6aea000362 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:57.050992 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-45a4b415-d164-4fb7-80bf-bb6aea000362 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:57.051778 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-45a4b415-d164-4fb7-80bf-bb6aea000362 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:57.113600 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-45a4b415-d164-4fb7-80bf-bb6aea000362 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:39:57.121301 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-45a4b415-d164-4fb7-80bf-bb6aea000362 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1186 microversion: 2.1 time: 0.083148 Jun 01 04:39:57.127639 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 510/1002] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:39:57 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1186 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:39:57.132560 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-275e3a76-6117-4c8a-be66-54a6bc3e430b tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:57.133917 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-275e3a76-6117-4c8a-be66-54a6bc3e430b tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: 4ab8a205-6fc8-4072-bd7b-f363a9d3740d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:57.136071 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell0:SELECT=2 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:39:57.136802 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell0:SELECT=6 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:39:57.142795 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-275e3a76-6117-4c8a-be66-54a6bc3e430b tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:57.151946 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-275e3a76-6117-4c8a-be66-54a6bc3e430b tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:57.152860 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-275e3a76-6117-4c8a-be66-54a6bc3e430b tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:57.153221 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-275e3a76-6117-4c8a-be66-54a6bc3e430b tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:57.306948 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-275e3a76-6117-4c8a-be66-54a6bc3e430b tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:39:57.315964 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-275e3a76-6117-4c8a-be66-54a6bc3e430b tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d" status: 200 len: 1313 microversion: 2.1 time: 0.189407 Jun 01 04:39:57.316552 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 493/1003] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:39:57 2022] GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:39:58.138076 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-6d214dbf-f3ba-4f7f-9202-c8a4a06a9789 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:58.138687 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-6d214dbf-f3ba-4f7f-9202-c8a4a06a9789 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:58.145256 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6d214dbf-f3ba-4f7f-9202-c8a4a06a9789 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:58.151755 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6d214dbf-f3ba-4f7f-9202-c8a4a06a9789 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:58.151755 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6d214dbf-f3ba-4f7f-9202-c8a4a06a9789 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:58.151755 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6d214dbf-f3ba-4f7f-9202-c8a4a06a9789 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:58.208561 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-6d214dbf-f3ba-4f7f-9202-c8a4a06a9789 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:39:58.216592 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-6d214dbf-f3ba-4f7f-9202-c8a4a06a9789 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1204 microversion: 2.1 time: 0.082389 Jun 01 04:39:58.217166 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 511/1004] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:39:58 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1204 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:39:58.334155 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-b818bd12-d485-4572-aa3a-99b7827ca139 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:58.335419 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-b818bd12-d485-4572-aa3a-99b7827ca139 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: 4ab8a205-6fc8-4072-bd7b-f363a9d3740d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:58.350049 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b818bd12-d485-4572-aa3a-99b7827ca139 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:58.350551 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b818bd12-d485-4572-aa3a-99b7827ca139 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:58.351717 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b818bd12-d485-4572-aa3a-99b7827ca139 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:58.352817 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b818bd12-d485-4572-aa3a-99b7827ca139 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:58.499074 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-b818bd12-d485-4572-aa3a-99b7827ca139 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:39:58.507612 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-b818bd12-d485-4572-aa3a-99b7827ca139 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d" status: 200 len: 1313 microversion: 2.1 time: 0.177566 Jun 01 04:39:58.508198 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 494/1005] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:39:58 2022] GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:39:59.234531 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-bf984d73-ac4c-4392-9cf2-4d56f05752d0 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:59.235332 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-bf984d73-ac4c-4392-9cf2-4d56f05752d0 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:59.241984 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bf984d73-ac4c-4392-9cf2-4d56f05752d0 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:59.242444 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bf984d73-ac4c-4392-9cf2-4d56f05752d0 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:59.243905 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bf984d73-ac4c-4392-9cf2-4d56f05752d0 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:59.244732 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bf984d73-ac4c-4392-9cf2-4d56f05752d0 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:59.337445 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-9d98d37d-53e9-494e-9678-784c131a2fb0 req-8e038def-c3b5-45f9-bd06-ae43e9550ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ab8a205-6fc8-4072-bd7b-f363a9d3740d", "name": "network-vif-plugged", "status": "completed", "tag": "5e7dd023-8558-49bd-b4eb-7df1c5bd51ce"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:39:59.356382 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-9d98d37d-53e9-494e-9678-784c131a2fb0 req-8e038def-c3b5-45f9-bd06-ae43e9550ea6 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:59.359924 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-9d98d37d-53e9-494e-9678-784c131a2fb0 req-8e038def-c3b5-45f9-bd06-ae43e9550ea6 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:59.376409 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-9d98d37d-53e9-494e-9678-784c131a2fb0 req-8e038def-c3b5-45f9-bd06-ae43e9550ea6 service nova] Creating event network-vif-plugged:5e7dd023-8558-49bd-b4eb-7df1c5bd51ce for instance 4ab8a205-6fc8-4072-bd7b-f363a9d3740d on hv-cinder-66710 Jun 01 04:39:59.378368 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-9d98d37d-53e9-494e-9678-784c131a2fb0 req-8e038def-c3b5-45f9-bd06-ae43e9550ea6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045964 Jun 01 04:39:59.382002 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 495/1006] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:39:59.387796 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-9e322e2c-bb50-4139-8bf3-096cdc8f66e6 req-d66cf1d4-8ed9-4216-922a-2966f8370c6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba731766-ac3f-4564-8c8a-09a909595ea3", "tag": "642b3902-1011-48e3-b526-4497466efc94"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:39:59.396492 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-9e322e2c-bb50-4139-8bf3-096cdc8f66e6 req-d66cf1d4-8ed9-4216-922a-2966f8370c6f service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:59.396940 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-9e322e2c-bb50-4139-8bf3-096cdc8f66e6 req-d66cf1d4-8ed9-4216-922a-2966f8370c6f service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:59.408112 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-9e322e2c-bb50-4139-8bf3-096cdc8f66e6 req-d66cf1d4-8ed9-4216-922a-2966f8370c6f service nova] Creating event network-changed:642b3902-1011-48e3-b526-4497466efc94 for instance ba731766-ac3f-4564-8c8a-09a909595ea3 on hv-cinder-66710 Jun 01 04:39:59.413951 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-9e322e2c-bb50-4139-8bf3-096cdc8f66e6 req-d66cf1d4-8ed9-4216-922a-2966f8370c6f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030305 Jun 01 04:39:59.415599 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 496/1007] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:39:59.457343 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-bf984d73-ac4c-4392-9cf2-4d56f05752d0 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:39:59.466528 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-bf984d73-ac4c-4392-9cf2-4d56f05752d0 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1259 microversion: 2.1 time: 0.236113 Jun 01 04:39:59.472165 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 512/1008] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:39:59 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1259 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:39:59.528156 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-bb45c878-f34c-4ac6-b453-529959041ba6 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:39:59.529218 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-bb45c878-f34c-4ac6-b453-529959041ba6 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: 4ab8a205-6fc8-4072-bd7b-f363a9d3740d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:39:59.536417 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bb45c878-f34c-4ac6-b453-529959041ba6 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:59.536812 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bb45c878-f34c-4ac6-b453-529959041ba6 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:59.537621 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bb45c878-f34c-4ac6-b453-529959041ba6 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:39:59.538062 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bb45c878-f34c-4ac6-b453-529959041ba6 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:39:59.695282 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-bb45c878-f34c-4ac6-b453-529959041ba6 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:39:59.702987 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-bb45c878-f34c-4ac6-b453-529959041ba6 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d" status: 200 len: 1313 microversion: 2.1 time: 0.180881 Jun 01 04:39:59.703625 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 497/1009] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:39:59 2022] GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:00.484094 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-fb0b8481-b0a9-46e2-b6ff-6c4a1c3c629f tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:00.484708 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-fb0b8481-b0a9-46e2-b6ff-6c4a1c3c629f tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:00.491235 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fb0b8481-b0a9-46e2-b6ff-6c4a1c3c629f tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:00.491727 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fb0b8481-b0a9-46e2-b6ff-6c4a1c3c629f tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:00.492531 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fb0b8481-b0a9-46e2-b6ff-6c4a1c3c629f tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:00.493477 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fb0b8481-b0a9-46e2-b6ff-6c4a1c3c629f tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:00.624124 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-fb0b8481-b0a9-46e2-b6ff-6c4a1c3c629f tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:00.631744 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-fb0b8481-b0a9-46e2-b6ff-6c4a1c3c629f tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1259 microversion: 2.1 time: 0.151810 Jun 01 04:40:00.632314 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 513/1010] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:00 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:00.723120 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-8449ce0d-6264-481e-a14b-f7b6fd1a7cd0 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:00.723811 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-8449ce0d-6264-481e-a14b-f7b6fd1a7cd0 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: 4ab8a205-6fc8-4072-bd7b-f363a9d3740d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:00.731498 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8449ce0d-6264-481e-a14b-f7b6fd1a7cd0 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:00.731943 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8449ce0d-6264-481e-a14b-f7b6fd1a7cd0 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:00.732708 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8449ce0d-6264-481e-a14b-f7b6fd1a7cd0 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:00.733145 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8449ce0d-6264-481e-a14b-f7b6fd1a7cd0 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:00.862357 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-8449ce0d-6264-481e-a14b-f7b6fd1a7cd0 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:00.870454 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-8449ce0d-6264-481e-a14b-f7b6fd1a7cd0 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d" status: 200 len: 1313 microversion: 2.1 time: 0.153416 Jun 01 04:40:00.871019 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 498/1011] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:00 2022] GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:01.649667 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-cbe8067d-fd2f-4330-89cf-a9550f3356d8 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:01.650290 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-cbe8067d-fd2f-4330-89cf-a9550f3356d8 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:01.656886 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cbe8067d-fd2f-4330-89cf-a9550f3356d8 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:01.657341 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cbe8067d-fd2f-4330-89cf-a9550f3356d8 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:01.658112 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cbe8067d-fd2f-4330-89cf-a9550f3356d8 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:01.658558 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cbe8067d-fd2f-4330-89cf-a9550f3356d8 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:01.791707 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-cbe8067d-fd2f-4330-89cf-a9550f3356d8 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:01.806553 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-cbe8067d-fd2f-4330-89cf-a9550f3356d8 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1259 microversion: 2.1 time: 0.161340 Jun 01 04:40:01.807063 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 514/1012] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:01 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:01.886842 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-09491fee-665c-4514-998d-1dc030ee6c94 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:01.887488 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-09491fee-665c-4514-998d-1dc030ee6c94 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: 4ab8a205-6fc8-4072-bd7b-f363a9d3740d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:01.893983 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-09491fee-665c-4514-998d-1dc030ee6c94 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:01.894431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-09491fee-665c-4514-998d-1dc030ee6c94 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:01.895213 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-09491fee-665c-4514-998d-1dc030ee6c94 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:01.895669 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-09491fee-665c-4514-998d-1dc030ee6c94 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:02.027488 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-09491fee-665c-4514-998d-1dc030ee6c94 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:02.034816 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-09491fee-665c-4514-998d-1dc030ee6c94 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d" status: 200 len: 1497 microversion: 2.1 time: 0.152522 Jun 01 04:40:02.035401 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 499/1013] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:01 2022] GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:02.823551 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-4c32026f-5bd9-4896-8453-9f6634b7ed1b tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:02.824625 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-4c32026f-5bd9-4896-8453-9f6634b7ed1b tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:02.831208 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4c32026f-5bd9-4896-8453-9f6634b7ed1b tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:02.831685 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4c32026f-5bd9-4896-8453-9f6634b7ed1b tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:02.832448 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4c32026f-5bd9-4896-8453-9f6634b7ed1b tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:02.832880 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4c32026f-5bd9-4896-8453-9f6634b7ed1b tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:02.967273 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-4c32026f-5bd9-4896-8453-9f6634b7ed1b tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:02.978030 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-4c32026f-5bd9-4896-8453-9f6634b7ed1b tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1259 microversion: 2.1 time: 0.158109 Jun 01 04:40:02.978920 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 515/1014] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:02 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:02.981045 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-d66309ed-892e-4bee-8beb-6744967a2c25 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:02.981600 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-d66309ed-892e-4bee-8beb-6744967a2c25 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: 4ab8a205-6fc8-4072-bd7b-f363a9d3740d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:02.988081 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d66309ed-892e-4bee-8beb-6744967a2c25 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:02.988528 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d66309ed-892e-4bee-8beb-6744967a2c25 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:02.989287 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d66309ed-892e-4bee-8beb-6744967a2c25 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:02.989722 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d66309ed-892e-4bee-8beb-6744967a2c25 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:03.014759 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-d66309ed-892e-4bee-8beb-6744967a2c25 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: 4ab8a205-6fc8-4072-bd7b-f363a9d3740d] Going to try to terminate instance {{(pid=118517) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 01 04:40:03.285520 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-d66309ed-892e-4bee-8beb-6744967a2c25 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d" status: 204 len: 0 microversion: 2.1 time: 0.310781 Jun 01 04:40:03.286111 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 500/1015] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 1 04:40:02 2022] DELETE /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 01 04:40:03.294423 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-f261f7aa-9070-40aa-9ca1-cfb51bccb910 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:03.295062 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-f261f7aa-9070-40aa-9ca1-cfb51bccb910 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: 4ab8a205-6fc8-4072-bd7b-f363a9d3740d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:03.301967 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f261f7aa-9070-40aa-9ca1-cfb51bccb910 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:03.302414 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f261f7aa-9070-40aa-9ca1-cfb51bccb910 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:03.303177 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f261f7aa-9070-40aa-9ca1-cfb51bccb910 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:03.303638 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f261f7aa-9070-40aa-9ca1-cfb51bccb910 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:03.436424 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-f261f7aa-9070-40aa-9ca1-cfb51bccb910 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:03.448503 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-f261f7aa-9070-40aa-9ca1-cfb51bccb910 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d" status: 200 len: 1503 microversion: 2.1 time: 0.158012 Jun 01 04:40:03.449061 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 516/1016] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:03 2022] GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:03.996966 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-cc29449d-23d4-4111-bd2b-14443268f0d1 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:03.997663 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-cc29449d-23d4-4111-bd2b-14443268f0d1 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:04.004215 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-cc29449d-23d4-4111-bd2b-14443268f0d1 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:04.005975 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-cc29449d-23d4-4111-bd2b-14443268f0d1 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:04.005975 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-cc29449d-23d4-4111-bd2b-14443268f0d1 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:04.005975 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-cc29449d-23d4-4111-bd2b-14443268f0d1 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:04.136846 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-cc29449d-23d4-4111-bd2b-14443268f0d1 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:04.144342 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-cc29449d-23d4-4111-bd2b-14443268f0d1 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1259 microversion: 2.1 time: 0.152495 Jun 01 04:40:04.144896 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 501/1017] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:03 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:04.466854 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-9e130596-d596-416f-83f6-6ef9b56ed164 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:04.467463 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-9e130596-d596-416f-83f6-6ef9b56ed164 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: 4ab8a205-6fc8-4072-bd7b-f363a9d3740d] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:04.469260 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell0:SELECT=2 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:40:04.474096 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9e130596-d596-416f-83f6-6ef9b56ed164 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:04.474545 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9e130596-d596-416f-83f6-6ef9b56ed164 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:04.475328 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9e130596-d596-416f-83f6-6ef9b56ed164 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:04.475769 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9e130596-d596-416f-83f6-6ef9b56ed164 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:04.609359 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-9e130596-d596-416f-83f6-6ef9b56ed164 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:04.616914 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-9e130596-d596-416f-83f6-6ef9b56ed164 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d" status: 200 len: 1503 microversion: 2.1 time: 0.154162 Jun 01 04:40:04.617483 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 517/1018] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:04 2022] GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:05.162227 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-45668357-b62e-4cb8-b369-561827a855d3 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:05.162871 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-45668357-b62e-4cb8-b369-561827a855d3 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:05.169742 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-45668357-b62e-4cb8-b369-561827a855d3 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:05.170218 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-45668357-b62e-4cb8-b369-561827a855d3 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:05.170984 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-45668357-b62e-4cb8-b369-561827a855d3 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:05.171444 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-45668357-b62e-4cb8-b369-561827a855d3 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:05.309761 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-45668357-b62e-4cb8-b369-561827a855d3 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:05.314432 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:40:05.319449 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-45668357-b62e-4cb8-b369-561827a855d3 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1259 microversion: 2.1 time: 0.161189 Jun 01 04:40:05.320032 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 502/1019] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:05 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:05.389360 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-d03178f1-4eff-4c35-8437-35308018d5b9 req-72aa1521-4232-48ad-bf37-64ad77e0daf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ab8a205-6fc8-4072-bd7b-f363a9d3740d", "name": "network-vif-deleted", "tag": "5e7dd023-8558-49bd-b4eb-7df1c5bd51ce"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:40:05.392941 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell0:SELECT=10 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:40:05.398089 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-d03178f1-4eff-4c35-8437-35308018d5b9 req-72aa1521-4232-48ad-bf37-64ad77e0daf1 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:05.398532 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-d03178f1-4eff-4c35-8437-35308018d5b9 req-72aa1521-4232-48ad-bf37-64ad77e0daf1 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:05.410085 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-d03178f1-4eff-4c35-8437-35308018d5b9 req-72aa1521-4232-48ad-bf37-64ad77e0daf1 service nova] Creating event network-vif-deleted:5e7dd023-8558-49bd-b4eb-7df1c5bd51ce for instance 4ab8a205-6fc8-4072-bd7b-f363a9d3740d on hv-cinder-66710 Jun 01 04:40:05.416981 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-d03178f1-4eff-4c35-8437-35308018d5b9 req-72aa1521-4232-48ad-bf37-64ad77e0daf1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029572 Jun 01 04:40:05.416981 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 518/1020] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:40:05.634665 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-37770b8d-019e-4c9d-8c92-36945ffac572 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:05.635278 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-37770b8d-019e-4c9d-8c92-36945ffac572 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: 4ab8a205-6fc8-4072-bd7b-f363a9d3740d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:05.642199 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-37770b8d-019e-4c9d-8c92-36945ffac572 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:05.642700 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-37770b8d-019e-4c9d-8c92-36945ffac572 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:05.643500 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-37770b8d-019e-4c9d-8c92-36945ffac572 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:05.643937 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-37770b8d-019e-4c9d-8c92-36945ffac572 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:05.704493 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-37770b8d-019e-4c9d-8c92-36945ffac572 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:05.712821 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-37770b8d-019e-4c9d-8c92-36945ffac572 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d" status: 200 len: 1298 microversion: 2.1 time: 0.082031 Jun 01 04:40:05.715150 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 503/1021] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:05 2022] GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d => generated 1298 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:06.338603 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-dabde5de-180a-49c4-a38e-052a74d361ce tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:06.339220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-dabde5de-180a-49c4-a38e-052a74d361ce tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:06.345863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-dabde5de-180a-49c4-a38e-052a74d361ce tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:06.346313 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-dabde5de-180a-49c4-a38e-052a74d361ce tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:06.347078 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-dabde5de-180a-49c4-a38e-052a74d361ce tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:06.347540 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-dabde5de-180a-49c4-a38e-052a74d361ce tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:06.481160 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-dabde5de-180a-49c4-a38e-052a74d361ce tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:06.488664 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-dabde5de-180a-49c4-a38e-052a74d361ce tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1259 microversion: 2.1 time: 0.155843 Jun 01 04:40:06.489226 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 519/1022] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:06 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:06.729679 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-4d3aec64-afec-4249-b89a-d2cabb533110 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:06.730289 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-4d3aec64-afec-4249-b89a-d2cabb533110 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: 4ab8a205-6fc8-4072-bd7b-f363a9d3740d] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:06.737317 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4d3aec64-afec-4249-b89a-d2cabb533110 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:06.737767 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4d3aec64-afec-4249-b89a-d2cabb533110 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:06.738531 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4d3aec64-afec-4249-b89a-d2cabb533110 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:06.738966 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4d3aec64-afec-4249-b89a-d2cabb533110 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:06.752307 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.wsgi [None req-4d3aec64-afec-4249-b89a-d2cabb533110 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] HTTP exception thrown: Instance 4ab8a205-6fc8-4072-bd7b-f363a9d3740d could not be found. Jun 01 04:40:06.753927 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-4d3aec64-afec-4249-b89a-d2cabb533110 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Request method failure captured: Jun 01 04:40:06.753927 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: request: GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d HTTP/1.1 Jun 01 04:40:06.753927 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept: application/json Jun 01 04:40:06.753927 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept-Encoding: identity Jun 01 04:40:06.753927 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Connection: close Jun 01 04:40:06.753927 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Length: 0 Jun 01 04:40:06.753927 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Type: application/json Jun 01 04:40:06.753927 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Host: 10.222.0.18 Jun 01 04:40:06.753927 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Openstack-System-Scope: None Jun 01 04:40:06.753927 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: User-Agent: python-urllib3/1.26.9 Jun 01 04:40:06.753927 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Auth-Token: gAAAAABilu2QrNoxHVM8cbw13Io70lMaErbilQ02-vx6Iknl0MQc8BZXvmnARXKQ4dhHy4JR_l-zbc9rRUHVC_47sxCOA9w1bgTdnPPLNfGghnEEVHxd7oINrTG65qXeRCSLzBx4SU3TpSUZz3LStl_jzglf594NPZ12d7S0QTZbME2_FXhHBEA Jun 01 04:40:06.753927 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Id: None Jun 01 04:40:06.753927 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Name: None Jun 01 04:40:06.753927 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Identity-Status: Confirmed Jun 01 04:40:06.753927 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Is-Admin-Project: True Jun 01 04:40:06.753927 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Id: default Jun 01 04:40:06.753927 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Name: Default Jun 01 04:40:06.753927 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Id: 6607408c2a46439d93026002d312b9de Jun 01 04:40:06.753927 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Name: tempest-VolumesActionsTest-769213739 Jun 01 04:40:06.753927 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Role: reader,member Jun 01 04:40:06.753927 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Roles: reader,member Jun 01 04:40:06.755643 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6607408c2a46439d93026002d312b9de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6607408c2a46439d93026002d312b9de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6607408c2a46439d93026002d312b9de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6607408c2a46439d93026002d312b9de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:40:06.755643 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant: tempest-VolumesActionsTest-769213739 Jun 01 04:40:06.755643 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Id: 6607408c2a46439d93026002d312b9de Jun 01 04:40:06.755643 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Name: tempest-VolumesActionsTest-769213739 Jun 01 04:40:06.755643 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User: tempest-VolumesActionsTest-769213739-project Jun 01 04:40:06.755643 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Id: default Jun 01 04:40:06.755643 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Name: Default Jun 01 04:40:06.755643 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Id: 80b97ad4fa674391a99cf97bc10da8bc Jun 01 04:40:06.755643 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Name: tempest-VolumesActionsTest-769213739-project Jun 01 04:40:06.755643 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: method: > Jun 01 04:40:06.755643 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: exception: Instance 4ab8a205-6fc8-4072-bd7b-f363a9d3740d could not be found. Jun 01 04:40:06.755643 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: action_args: {'id': '4ab8a205-6fc8-4072-bd7b-f363a9d3740d'} Jun 01 04:40:06.756753 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:40:06.756753 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:40:06.756753 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:40:06.756753 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:40:06.756753 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:40:06.756753 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:40:06.756753 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:40:06.756753 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:40:06.756753 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:40:06.756753 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:40:06.756753 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ab8a205-6fc8-4072-bd7b-f363a9d3740d could not be found. Jun 01 04:40:06.756753 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:40:06.756753 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:40:06.756753 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:40:06.756753 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:40:06.756753 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:40:06.756753 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:40:06.756753 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:40:06.756753 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:40:06.756753 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:40:06.758890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:40:06.758890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 01 04:40:06.758890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 01 04:40:06.758890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:40:06.758890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:40:06.758890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:40:06.758890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:40:06.758890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ab8a205-6fc8-4072-bd7b-f363a9d3740d could not be found. Jun 01 04:40:06.758890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:40:06.758890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:40:06.758890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:40:06.758890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:40:06.758890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:40:06.758890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:40:06.758890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:40:06.758890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:40:06.758890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ab8a205-6fc8-4072-bd7b-f363a9d3740d could not be found. Jun 01 04:40:06.758890 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:40:06.760245 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-4d3aec64-afec-4249-b89a-d2cabb533110 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Returning 404 to user: Instance 4ab8a205-6fc8-4072-bd7b-f363a9d3740d could not be found. {{(pid=118517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:40:06.760245 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-4d3aec64-afec-4249-b89a-d2cabb533110 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d" status: 404 len: 111 microversion: 2.1 time: 0.029842 Jun 01 04:40:06.760245 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 504/1023] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:06 2022] GET /compute/v2.1/servers/4ab8a205-6fc8-4072-bd7b-f363a9d3740d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:40:06.804491 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-41066687-741b-45de-aa5e-1816ca61ccfd tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1123187315", "imageRef": "14321baa-3ac5-4c53-8054-4945abce5b2d", "flavorRef": "452", "networks": [{"uuid": "38efa17b-6b81-41c1-9aa7-2e9653e0399f"}]}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:40:06.854478 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.network.neutron [None req-41066687-741b-45de-aa5e-1816ca61ccfd tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] validate_networks() for [('38efa17b-6b81-41c1-9aa7-2e9653e0399f', None, None, None, None, None)] {{(pid=118516) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 01 04:40:07.200063 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-41066687-741b-45de-aa5e-1816ca61ccfd tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Flavor limits 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 01 04:40:07.200486 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-41066687-741b-45de-aa5e-1816ca61ccfd tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Image limits 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 01 04:40:07.200990 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-41066687-741b-45de-aa5e-1816ca61ccfd tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Flavor pref 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 01 04:40:07.201396 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-41066687-741b-45de-aa5e-1816ca61ccfd tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Image pref 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 01 04:40:07.201805 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-41066687-741b-45de-aa5e-1816ca61ccfd tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 01 04:40:07.210729 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-41066687-741b-45de-aa5e-1816ca61ccfd tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:07.211175 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-41066687-741b-45de-aa5e-1816ca61ccfd tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:07.212086 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-41066687-741b-45de-aa5e-1816ca61ccfd tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:07.212519 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-41066687-741b-45de-aa5e-1816ca61ccfd tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:07.229843 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-41066687-741b-45de-aa5e-1816ca61ccfd tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Getting quotas for project 6607408c2a46439d93026002d312b9de. Resources: {'ram', 'instances', 'cores'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:40:07.233943 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-41066687-741b-45de-aa5e-1816ca61ccfd tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Getting quotas for user 80b97ad4fa674391a99cf97bc10da8bc and project 6607408c2a46439d93026002d312b9de. Resources: {'ram', 'instances', 'cores'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:40:07.245302 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-41066687-741b-45de-aa5e-1816ca61ccfd tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Going to run 1 instances... {{(pid=118516) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 01 04:40:07.247540 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-41066687-741b-45de-aa5e-1816ca61ccfd tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: ebfba014-6e18-4a9b-a313-fb8d34eef6b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14321baa-3ac5-4c53-8054-4945abce5b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 01 04:40:07.390964 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-41066687-741b-45de-aa5e-1816ca61ccfd tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.589894 Jun 01 04:40:07.392958 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 520/1024] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 1 04:40:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 01 04:40:07.402565 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-48a1c303-15f5-4dd4-af51-98f5ea58a131 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:07.403257 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-48a1c303-15f5-4dd4-af51-98f5ea58a131 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: ebfba014-6e18-4a9b-a313-fb8d34eef6b0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:07.456040 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-48a1c303-15f5-4dd4-af51-98f5ea58a131 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:07.462701 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-48a1c303-15f5-4dd4-af51-98f5ea58a131 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0" status: 200 len: 1214 microversion: 2.1 time: 0.064413 Jun 01 04:40:07.463261 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 505/1025] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:07 2022] GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:07.506046 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-5944ed36-9161-44eb-bbf2-e072379be0c2 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:07.507012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-5944ed36-9161-44eb-bbf2-e072379be0c2 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:07.513080 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5944ed36-9161-44eb-bbf2-e072379be0c2 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:07.513531 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5944ed36-9161-44eb-bbf2-e072379be0c2 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:07.514290 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5944ed36-9161-44eb-bbf2-e072379be0c2 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:07.514724 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5944ed36-9161-44eb-bbf2-e072379be0c2 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:07.647733 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-5944ed36-9161-44eb-bbf2-e072379be0c2 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:07.655068 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-5944ed36-9161-44eb-bbf2-e072379be0c2 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1259 microversion: 2.1 time: 0.153056 Jun 01 04:40:07.655682 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 521/1026] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:07 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:08.480088 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-6243a61f-be5c-4c7c-9265-f060ac282d68 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:08.480972 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-6243a61f-be5c-4c7c-9265-f060ac282d68 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: ebfba014-6e18-4a9b-a313-fb8d34eef6b0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:08.488224 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6243a61f-be5c-4c7c-9265-f060ac282d68 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:08.488671 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6243a61f-be5c-4c7c-9265-f060ac282d68 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:08.489448 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6243a61f-be5c-4c7c-9265-f060ac282d68 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:08.489880 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6243a61f-be5c-4c7c-9265-f060ac282d68 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:08.550587 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-6243a61f-be5c-4c7c-9265-f060ac282d68 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:08.558242 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-6243a61f-be5c-4c7c-9265-f060ac282d68 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0" status: 200 len: 1218 microversion: 2.1 time: 0.082705 Jun 01 04:40:08.558791 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 506/1027] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:08 2022] GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:08.672541 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-1514a212-ef7d-46d3-83bd-35f5ee85f965 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:08.673174 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-1514a212-ef7d-46d3-83bd-35f5ee85f965 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:08.679859 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1514a212-ef7d-46d3-83bd-35f5ee85f965 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:08.680314 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1514a212-ef7d-46d3-83bd-35f5ee85f965 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:08.681084 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1514a212-ef7d-46d3-83bd-35f5ee85f965 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:08.681522 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1514a212-ef7d-46d3-83bd-35f5ee85f965 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:08.811223 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-1514a212-ef7d-46d3-83bd-35f5ee85f965 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:08.818783 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-1514a212-ef7d-46d3-83bd-35f5ee85f965 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1259 microversion: 2.1 time: 0.150223 Jun 01 04:40:08.823529 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 522/1028] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:08 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:09.574959 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-10cc181e-fccc-40dd-98ed-9c967b5ce4d0 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:09.575702 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-10cc181e-fccc-40dd-98ed-9c967b5ce4d0 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: ebfba014-6e18-4a9b-a313-fb8d34eef6b0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:09.582732 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-10cc181e-fccc-40dd-98ed-9c967b5ce4d0 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:09.583192 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-10cc181e-fccc-40dd-98ed-9c967b5ce4d0 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:09.584028 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-10cc181e-fccc-40dd-98ed-9c967b5ce4d0 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:09.584488 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-10cc181e-fccc-40dd-98ed-9c967b5ce4d0 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:09.656543 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-10cc181e-fccc-40dd-98ed-9c967b5ce4d0 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:09.664323 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-10cc181e-fccc-40dd-98ed-9c967b5ce4d0 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0" status: 200 len: 1266 microversion: 2.1 time: 0.093829 Jun 01 04:40:09.664949 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 507/1029] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:09 2022] GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0 => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:09.835659 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-96e04ba4-d435-41aa-9915-29a6a70ea77d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:09.836277 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-96e04ba4-d435-41aa-9915-29a6a70ea77d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:09.843048 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-96e04ba4-d435-41aa-9915-29a6a70ea77d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:09.844099 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-96e04ba4-d435-41aa-9915-29a6a70ea77d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:09.844542 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-96e04ba4-d435-41aa-9915-29a6a70ea77d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:09.844842 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-96e04ba4-d435-41aa-9915-29a6a70ea77d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:10.054580 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-96e04ba4-d435-41aa-9915-29a6a70ea77d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:10.063656 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-96e04ba4-d435-41aa-9915-29a6a70ea77d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1259 microversion: 2.1 time: 0.231784 Jun 01 04:40:10.064245 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 523/1030] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:09 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1259 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:10.596948 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-4370a7c8-b0fe-4dc9-8b4e-c8b97c5d436e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:10.598074 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-4370a7c8-b0fe-4dc9-8b4e-c8b97c5d436e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: ae96e93e-9319-4283-91f7-c2474eeb9927] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:10.598636 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-461dbfb7-c382-4c30-b0bc-2a59b1044edd req-8f487241-70be-4676-8be3-8e8f874ddd54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae96e93e-9319-4283-91f7-c2474eeb9927", "tag": "c95f4a69-1577-4402-b2af-06fb5349e287"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:40:10.605936 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4370a7c8-b0fe-4dc9-8b4e-c8b97c5d436e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:10.606464 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4370a7c8-b0fe-4dc9-8b4e-c8b97c5d436e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:10.609662 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-461dbfb7-c382-4c30-b0bc-2a59b1044edd req-8f487241-70be-4676-8be3-8e8f874ddd54 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:10.609792 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4370a7c8-b0fe-4dc9-8b4e-c8b97c5d436e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:10.609883 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-461dbfb7-c382-4c30-b0bc-2a59b1044edd req-8f487241-70be-4676-8be3-8e8f874ddd54 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:10.609980 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4370a7c8-b0fe-4dc9-8b4e-c8b97c5d436e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:10.611514 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=100 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:40:10.629968 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-461dbfb7-c382-4c30-b0bc-2a59b1044edd req-8f487241-70be-4676-8be3-8e8f874ddd54 service nova] Creating event network-changed:c95f4a69-1577-4402-b2af-06fb5349e287 for instance ae96e93e-9319-4283-91f7-c2474eeb9927 on hv-cinder-66710 Jun 01 04:40:10.636968 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-461dbfb7-c382-4c30-b0bc-2a59b1044edd req-8f487241-70be-4676-8be3-8e8f874ddd54 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041854 Jun 01 04:40:10.637225 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-4370a7c8-b0fe-4dc9-8b4e-c8b97c5d436e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: ae96e93e-9319-4283-91f7-c2474eeb9927] Going to try to terminate instance {{(pid=118517) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 01 04:40:10.637579 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 524/1031] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:40:10.682407 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-9e1d4c19-4cf3-451d-b457-e56e7f140c60 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:10.683064 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-9e1d4c19-4cf3-451d-b457-e56e7f140c60 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: ebfba014-6e18-4a9b-a313-fb8d34eef6b0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:10.691195 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9e1d4c19-4cf3-451d-b457-e56e7f140c60 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:10.691682 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9e1d4c19-4cf3-451d-b457-e56e7f140c60 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:10.692470 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9e1d4c19-4cf3-451d-b457-e56e7f140c60 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:10.692908 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9e1d4c19-4cf3-451d-b457-e56e7f140c60 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:10.791647 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-9e1d4c19-4cf3-451d-b457-e56e7f140c60 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:10.802581 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-9e1d4c19-4cf3-451d-b457-e56e7f140c60 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0" status: 200 len: 1272 microversion: 2.1 time: 0.124260 Jun 01 04:40:10.803826 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 525/1032] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:10 2022] GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0 => generated 1272 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:40:10.974404 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-4370a7c8-b0fe-4dc9-8b4e-c8b97c5d436e tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927" status: 204 len: 0 microversion: 2.1 time: 0.380219 Jun 01 04:40:10.977085 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 508/1033] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 1 04:40:10 2022] DELETE /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 01 04:40:10.985588 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-7efeeefa-5185-4c5f-b2da-1b36fcccee01 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:10.986176 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-7efeeefa-5185-4c5f-b2da-1b36fcccee01 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: ae96e93e-9319-4283-91f7-c2474eeb9927] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:10.994895 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7efeeefa-5185-4c5f-b2da-1b36fcccee01 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:10.995802 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7efeeefa-5185-4c5f-b2da-1b36fcccee01 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:10.998975 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7efeeefa-5185-4c5f-b2da-1b36fcccee01 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:10.999792 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7efeeefa-5185-4c5f-b2da-1b36fcccee01 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:11.081492 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-6a10b345-6652-4c71-9b24-366a773f5cc4 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:11.082211 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-6a10b345-6652-4c71-9b24-366a773f5cc4 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:11.088808 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6a10b345-6652-4c71-9b24-366a773f5cc4 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:11.089354 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6a10b345-6652-4c71-9b24-366a773f5cc4 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:11.090218 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6a10b345-6652-4c71-9b24-366a773f5cc4 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:11.090732 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6a10b345-6652-4c71-9b24-366a773f5cc4 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:11.254804 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-6a10b345-6652-4c71-9b24-366a773f5cc4 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:11.264710 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-6a10b345-6652-4c71-9b24-366a773f5cc4 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1259 microversion: 2.1 time: 0.187425 Jun 01 04:40:11.273156 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 509/1034] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:11 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1259 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:40:11.518229 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-7efeeefa-5185-4c5f-b2da-1b36fcccee01 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:11.528109 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-7efeeefa-5185-4c5f-b2da-1b36fcccee01 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927" status: 200 len: 1576 microversion: 2.1 time: 0.546489 Jun 01 04:40:11.529429 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 526/1035] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:10 2022] GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927 => generated 1576 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:11.826032 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-41f42543-f366-4f8a-88a3-21e30c41786e tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:11.826662 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-41f42543-f366-4f8a-88a3-21e30c41786e tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: ebfba014-6e18-4a9b-a313-fb8d34eef6b0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:11.833148 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-41f42543-f366-4f8a-88a3-21e30c41786e tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:11.833630 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-41f42543-f366-4f8a-88a3-21e30c41786e tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:11.834416 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-41f42543-f366-4f8a-88a3-21e30c41786e tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:11.834858 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-41f42543-f366-4f8a-88a3-21e30c41786e tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:11.972319 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-41f42543-f366-4f8a-88a3-21e30c41786e tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:11.980089 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-41f42543-f366-4f8a-88a3-21e30c41786e tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0" status: 200 len: 1314 microversion: 2.1 time: 0.158017 Jun 01 04:40:11.980933 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 510/1036] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:11 2022] GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:12.283582 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-7fe67020-7bee-4062-a98d-e405d577b84a tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:12.284209 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-7fe67020-7bee-4062-a98d-e405d577b84a tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:12.290510 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7fe67020-7bee-4062-a98d-e405d577b84a tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:12.291256 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7fe67020-7bee-4062-a98d-e405d577b84a tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:12.292157 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7fe67020-7bee-4062-a98d-e405d577b84a tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:12.292602 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7fe67020-7bee-4062-a98d-e405d577b84a tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:12.489435 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-7fe67020-7bee-4062-a98d-e405d577b84a tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:12.497520 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-7fe67020-7bee-4062-a98d-e405d577b84a tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1259 microversion: 2.1 time: 0.218140 Jun 01 04:40:12.498090 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 527/1037] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:12 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1259 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:12.547152 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-bc508cd2-71e4-43a6-97e6-cc54ea410688 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:12.547876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-bc508cd2-71e4-43a6-97e6-cc54ea410688 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: ae96e93e-9319-4283-91f7-c2474eeb9927] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:12.553877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bc508cd2-71e4-43a6-97e6-cc54ea410688 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:12.554320 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bc508cd2-71e4-43a6-97e6-cc54ea410688 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:12.555076 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bc508cd2-71e4-43a6-97e6-cc54ea410688 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:12.555534 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bc508cd2-71e4-43a6-97e6-cc54ea410688 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:12.699791 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-bc508cd2-71e4-43a6-97e6-cc54ea410688 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:12.707522 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-bc508cd2-71e4-43a6-97e6-cc54ea410688 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927" status: 200 len: 1576 microversion: 2.1 time: 0.164282 Jun 01 04:40:12.708090 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 511/1038] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:12 2022] GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:12.983542 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-eea98897-d35b-4f92-a4ac-8271be327551 req-44ab8db4-4516-4067-8736-ca8b378e47e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebfba014-6e18-4a9b-a313-fb8d34eef6b0", "tag": "1f43de81-668e-4988-8403-8239559b3e47"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:40:12.993270 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-eea98897-d35b-4f92-a4ac-8271be327551 req-44ab8db4-4516-4067-8736-ca8b378e47e1 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:12.994448 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-eea98897-d35b-4f92-a4ac-8271be327551 req-44ab8db4-4516-4067-8736-ca8b378e47e1 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:13.004207 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-792c81a3-c386-4d42-ad33-f44eed26b246 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:13.005498 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-792c81a3-c386-4d42-ad33-f44eed26b246 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: ebfba014-6e18-4a9b-a313-fb8d34eef6b0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:13.013687 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-792c81a3-c386-4d42-ad33-f44eed26b246 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:13.014130 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-792c81a3-c386-4d42-ad33-f44eed26b246 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:13.014927 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-792c81a3-c386-4d42-ad33-f44eed26b246 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:13.015381 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-792c81a3-c386-4d42-ad33-f44eed26b246 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:13.027106 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-eea98897-d35b-4f92-a4ac-8271be327551 req-44ab8db4-4516-4067-8736-ca8b378e47e1 service nova] Creating event network-changed:1f43de81-668e-4988-8403-8239559b3e47 for instance ebfba014-6e18-4a9b-a313-fb8d34eef6b0 on hv-cinder-66710 Jun 01 04:40:13.032613 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-eea98897-d35b-4f92-a4ac-8271be327551 req-44ab8db4-4516-4067-8736-ca8b378e47e1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054628 Jun 01 04:40:13.033216 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 528/1039] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:40:13.221148 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-792c81a3-c386-4d42-ad33-f44eed26b246 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:13.229534 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-792c81a3-c386-4d42-ad33-f44eed26b246 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0" status: 200 len: 1314 microversion: 2.1 time: 0.230195 Jun 01 04:40:13.237737 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 512/1040] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:12 2022] GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:13.361967 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-aa8af276-1957-4ace-bb6e-5ef290f4a193 req-a529496f-76f9-49e8-9343-7c0630ec3b57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba731766-ac3f-4564-8c8a-09a909595ea3", "name": "network-vif-plugged", "status": "completed", "tag": "642b3902-1011-48e3-b526-4497466efc94"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:40:13.372343 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-aa8af276-1957-4ace-bb6e-5ef290f4a193 req-a529496f-76f9-49e8-9343-7c0630ec3b57 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:13.372838 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-aa8af276-1957-4ace-bb6e-5ef290f4a193 req-a529496f-76f9-49e8-9343-7c0630ec3b57 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:13.384094 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-aa8af276-1957-4ace-bb6e-5ef290f4a193 req-a529496f-76f9-49e8-9343-7c0630ec3b57 service nova] Creating event network-vif-plugged:642b3902-1011-48e3-b526-4497466efc94 for instance ba731766-ac3f-4564-8c8a-09a909595ea3 on hv-cinder-66710 Jun 01 04:40:13.389608 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-aa8af276-1957-4ace-bb6e-5ef290f4a193 req-a529496f-76f9-49e8-9343-7c0630ec3b57 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031826 Jun 01 04:40:13.392522 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 529/1041] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:40:13.515472 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-dedbbcba-ce60-4332-8e9f-a509d6e1c362 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:13.516278 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-dedbbcba-ce60-4332-8e9f-a509d6e1c362 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:13.523014 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-dedbbcba-ce60-4332-8e9f-a509d6e1c362 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:13.525689 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-dedbbcba-ce60-4332-8e9f-a509d6e1c362 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:13.525689 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-dedbbcba-ce60-4332-8e9f-a509d6e1c362 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:13.525689 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-dedbbcba-ce60-4332-8e9f-a509d6e1c362 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:13.727266 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b7480370-1131-4433-b47a-9ceafe4d7513 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:13.728608 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-b7480370-1131-4433-b47a-9ceafe4d7513 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: ae96e93e-9319-4283-91f7-c2474eeb9927] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:13.735828 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b7480370-1131-4433-b47a-9ceafe4d7513 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:13.737361 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b7480370-1131-4433-b47a-9ceafe4d7513 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:13.737361 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b7480370-1131-4433-b47a-9ceafe4d7513 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:13.737540 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b7480370-1131-4433-b47a-9ceafe4d7513 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:13.840371 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b7480370-1131-4433-b47a-9ceafe4d7513 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:13.852238 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-b7480370-1131-4433-b47a-9ceafe4d7513 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927" status: 200 len: 1391 microversion: 2.1 time: 0.130860 Jun 01 04:40:13.853658 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 530/1042] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:13 2022] GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927 => generated 1391 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:13.870588 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-dedbbcba-ce60-4332-8e9f-a509d6e1c362 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:13.879056 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-dedbbcba-ce60-4332-8e9f-a509d6e1c362 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1259 microversion: 2.1 time: 0.367763 Jun 01 04:40:13.879921 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 513/1043] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:13 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1259 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:13.992590 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-f503a935-b4ae-4ea4-b693-e11abbb67250 req-647215a3-0913-41e6-97dd-44fd0d51dbf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae96e93e-9319-4283-91f7-c2474eeb9927", "name": "network-vif-deleted", "tag": "c95f4a69-1577-4402-b2af-06fb5349e287"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:40:14.001265 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-f503a935-b4ae-4ea4-b693-e11abbb67250 req-647215a3-0913-41e6-97dd-44fd0d51dbf9 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:14.001708 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-f503a935-b4ae-4ea4-b693-e11abbb67250 req-647215a3-0913-41e6-97dd-44fd0d51dbf9 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:14.015290 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-f503a935-b4ae-4ea4-b693-e11abbb67250 req-647215a3-0913-41e6-97dd-44fd0d51dbf9 service nova] Creating event network-vif-deleted:c95f4a69-1577-4402-b2af-06fb5349e287 for instance ae96e93e-9319-4283-91f7-c2474eeb9927 on hv-cinder-66710 Jun 01 04:40:14.020281 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-f503a935-b4ae-4ea4-b693-e11abbb67250 req-647215a3-0913-41e6-97dd-44fd0d51dbf9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164746 Jun 01 04:40:14.021042 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 531/1044] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:40:14.246237 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a71c6cc7-1f60-43d3-874e-1a925134ce30 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:14.246826 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-a71c6cc7-1f60-43d3-874e-1a925134ce30 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: ebfba014-6e18-4a9b-a313-fb8d34eef6b0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:14.253435 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a71c6cc7-1f60-43d3-874e-1a925134ce30 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:14.253885 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a71c6cc7-1f60-43d3-874e-1a925134ce30 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:14.254647 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a71c6cc7-1f60-43d3-874e-1a925134ce30 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:14.255084 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a71c6cc7-1f60-43d3-874e-1a925134ce30 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:14.387831 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-a71c6cc7-1f60-43d3-874e-1a925134ce30 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:14.395276 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-a71c6cc7-1f60-43d3-874e-1a925134ce30 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0" status: 200 len: 1314 microversion: 2.1 time: 0.153423 Jun 01 04:40:14.395879 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 514/1045] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:14 2022] GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:14.873291 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-a936f013-5ef1-4f94-bc9f-0ee0a6b5deb9 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:14.873991 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-a936f013-5ef1-4f94-bc9f-0ee0a6b5deb9 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: ae96e93e-9319-4283-91f7-c2474eeb9927] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:14.882843 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a936f013-5ef1-4f94-bc9f-0ee0a6b5deb9 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:14.882843 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a936f013-5ef1-4f94-bc9f-0ee0a6b5deb9 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:14.882843 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a936f013-5ef1-4f94-bc9f-0ee0a6b5deb9 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:14.882843 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a936f013-5ef1-4f94-bc9f-0ee0a6b5deb9 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:14.896314 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-925ff8bc-ba06-4b82-9717-324045ec29dd tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:14.896943 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-925ff8bc-ba06-4b82-9717-324045ec29dd tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:14.903154 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-925ff8bc-ba06-4b82-9717-324045ec29dd tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:14.904301 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-925ff8bc-ba06-4b82-9717-324045ec29dd tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:14.905104 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-925ff8bc-ba06-4b82-9717-324045ec29dd tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:14.905692 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-925ff8bc-ba06-4b82-9717-324045ec29dd tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:14.947663 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-a936f013-5ef1-4f94-bc9f-0ee0a6b5deb9 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:14.955386 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-a936f013-5ef1-4f94-bc9f-0ee0a6b5deb9 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927" status: 200 len: 1226 microversion: 2.1 time: 0.088002 Jun 01 04:40:14.955963 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 532/1046] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:14 2022] GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:15.037104 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-925ff8bc-ba06-4b82-9717-324045ec29dd tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:15.045246 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-925ff8bc-ba06-4b82-9717-324045ec29dd tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1259 microversion: 2.1 time: 0.152738 Jun 01 04:40:15.045808 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 515/1047] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:14 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:40:15.412019 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-a7dcee66-e455-4a5e-a555-35076fad35fb tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:15.412632 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-a7dcee66-e455-4a5e-a555-35076fad35fb tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: ebfba014-6e18-4a9b-a313-fb8d34eef6b0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:15.418808 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a7dcee66-e455-4a5e-a555-35076fad35fb tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:15.419265 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a7dcee66-e455-4a5e-a555-35076fad35fb tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:15.420074 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a7dcee66-e455-4a5e-a555-35076fad35fb tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:15.420506 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a7dcee66-e455-4a5e-a555-35076fad35fb tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:15.552337 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-a7dcee66-e455-4a5e-a555-35076fad35fb tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:15.560452 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-a7dcee66-e455-4a5e-a555-35076fad35fb tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0" status: 200 len: 1314 microversion: 2.1 time: 0.152271 Jun 01 04:40:15.561022 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 533/1048] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:15 2022] GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:15.972897 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-773c5e06-5ed4-47e6-b4c9-aa9dd80a14d3 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:15.973447 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-773c5e06-5ed4-47e6-b4c9-aa9dd80a14d3 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: ae96e93e-9319-4283-91f7-c2474eeb9927] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:15.979883 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-773c5e06-5ed4-47e6-b4c9-aa9dd80a14d3 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:15.980596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-773c5e06-5ed4-47e6-b4c9-aa9dd80a14d3 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:15.981348 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-773c5e06-5ed4-47e6-b4c9-aa9dd80a14d3 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:15.981782 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-773c5e06-5ed4-47e6-b4c9-aa9dd80a14d3 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:16.012688 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-773c5e06-5ed4-47e6-b4c9-aa9dd80a14d3 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:16.013132 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-773c5e06-5ed4-47e6-b4c9-aa9dd80a14d3 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:16.013573 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.objects.instance [None req-773c5e06-5ed4-47e6-b4c9-aa9dd80a14d3 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lazy-loading 'fault' on Instance uuid ae96e93e-9319-4283-91f7-c2474eeb9927 {{(pid=118517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:40:16.052905 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-773c5e06-5ed4-47e6-b4c9-aa9dd80a14d3 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:16.060992 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-773c5e06-5ed4-47e6-b4c9-aa9dd80a14d3 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927" status: 200 len: 1231 microversion: 2.1 time: 0.092031 Jun 01 04:40:16.061592 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 516/1049] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:15 2022] GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927 => generated 1231 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:16.063322 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-5b3fe19f-c187-4eab-9533-90e0bab35a34 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:16.063956 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-5b3fe19f-c187-4eab-9533-90e0bab35a34 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:16.070477 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5b3fe19f-c187-4eab-9533-90e0bab35a34 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:16.070925 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5b3fe19f-c187-4eab-9533-90e0bab35a34 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:16.072349 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5b3fe19f-c187-4eab-9533-90e0bab35a34 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:16.072799 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-5b3fe19f-c187-4eab-9533-90e0bab35a34 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:16.203691 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-5b3fe19f-c187-4eab-9533-90e0bab35a34 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:16.211060 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-5b3fe19f-c187-4eab-9533-90e0bab35a34 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1259 microversion: 2.1 time: 0.152473 Jun 01 04:40:16.211662 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 534/1050] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:16 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:40:16.577806 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-230260ef-cb56-4345-af3d-dd6885d0f564 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:16.578444 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-230260ef-cb56-4345-af3d-dd6885d0f564 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: ebfba014-6e18-4a9b-a313-fb8d34eef6b0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:16.580394 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:40:16.585128 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-230260ef-cb56-4345-af3d-dd6885d0f564 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:16.585577 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-230260ef-cb56-4345-af3d-dd6885d0f564 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:16.586350 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-230260ef-cb56-4345-af3d-dd6885d0f564 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:16.586784 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-230260ef-cb56-4345-af3d-dd6885d0f564 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:16.717741 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-230260ef-cb56-4345-af3d-dd6885d0f564 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:16.725138 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-230260ef-cb56-4345-af3d-dd6885d0f564 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0" status: 200 len: 1314 microversion: 2.1 time: 0.151268 Jun 01 04:40:16.725694 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 517/1051] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:16 2022] GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:17.079611 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-21be82ed-c1de-4471-b055-1fa9e6a76103 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:17.080588 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-21be82ed-c1de-4471-b055-1fa9e6a76103 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: ae96e93e-9319-4283-91f7-c2474eeb9927] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:17.087863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-21be82ed-c1de-4471-b055-1fa9e6a76103 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:17.088315 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-21be82ed-c1de-4471-b055-1fa9e6a76103 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:17.089092 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-21be82ed-c1de-4471-b055-1fa9e6a76103 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:17.089523 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-21be82ed-c1de-4471-b055-1fa9e6a76103 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:17.122374 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-21be82ed-c1de-4471-b055-1fa9e6a76103 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:17.122824 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-21be82ed-c1de-4471-b055-1fa9e6a76103 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:17.123275 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.objects.instance [None req-21be82ed-c1de-4471-b055-1fa9e6a76103 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lazy-loading 'fault' on Instance uuid ae96e93e-9319-4283-91f7-c2474eeb9927 {{(pid=118516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:40:17.163829 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-21be82ed-c1de-4471-b055-1fa9e6a76103 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:17.171962 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-21be82ed-c1de-4471-b055-1fa9e6a76103 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927" status: 200 len: 1231 microversion: 2.1 time: 0.096506 Jun 01 04:40:17.172532 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 535/1052] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:17 2022] GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927 => generated 1231 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:17.231432 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-095b2e16-194e-45be-9e36-f2a844eeba53 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:17.232569 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-095b2e16-194e-45be-9e36-f2a844eeba53 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:17.244459 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-095b2e16-194e-45be-9e36-f2a844eeba53 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:17.245418 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-095b2e16-194e-45be-9e36-f2a844eeba53 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:17.246598 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-095b2e16-194e-45be-9e36-f2a844eeba53 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:17.247398 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-095b2e16-194e-45be-9e36-f2a844eeba53 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:17.387473 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-095b2e16-194e-45be-9e36-f2a844eeba53 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:17.394916 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-095b2e16-194e-45be-9e36-f2a844eeba53 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1259 microversion: 2.1 time: 0.171420 Jun 01 04:40:17.395509 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 518/1053] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:17 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:40:17.742020 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-fde8abe2-de23-4384-9be8-bac3c8d1e968 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:17.742629 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-fde8abe2-de23-4384-9be8-bac3c8d1e968 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: ebfba014-6e18-4a9b-a313-fb8d34eef6b0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:17.745150 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell0:SELECT=2 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:40:17.745814 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell0:SELECT=6 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:40:17.750558 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fde8abe2-de23-4384-9be8-bac3c8d1e968 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:17.751033 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fde8abe2-de23-4384-9be8-bac3c8d1e968 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:17.751840 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fde8abe2-de23-4384-9be8-bac3c8d1e968 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:17.752281 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fde8abe2-de23-4384-9be8-bac3c8d1e968 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:17.893609 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-fde8abe2-de23-4384-9be8-bac3c8d1e968 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:17.901190 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-fde8abe2-de23-4384-9be8-bac3c8d1e968 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0" status: 200 len: 1314 microversion: 2.1 time: 0.163071 Jun 01 04:40:17.901746 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 536/1054] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:17 2022] GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:18.188660 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-f9a18386-b6d0-41c9-915f-4025801cddfd tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:18.189306 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-f9a18386-b6d0-41c9-915f-4025801cddfd tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: ae96e93e-9319-4283-91f7-c2474eeb9927] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:18.191192 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell0:SELECT=2 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:40:18.196426 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f9a18386-b6d0-41c9-915f-4025801cddfd tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:18.197434 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f9a18386-b6d0-41c9-915f-4025801cddfd tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:18.198235 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f9a18386-b6d0-41c9-915f-4025801cddfd tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:18.198677 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f9a18386-b6d0-41c9-915f-4025801cddfd tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:18.203237 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:40:18.233144 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f9a18386-b6d0-41c9-915f-4025801cddfd tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:18.233808 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f9a18386-b6d0-41c9-915f-4025801cddfd tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:18.234048 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.objects.instance [None req-f9a18386-b6d0-41c9-915f-4025801cddfd tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lazy-loading 'fault' on Instance uuid ae96e93e-9319-4283-91f7-c2474eeb9927 {{(pid=118517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:40:18.283076 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-f9a18386-b6d0-41c9-915f-4025801cddfd tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:18.290182 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-f9a18386-b6d0-41c9-915f-4025801cddfd tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927" status: 200 len: 1185 microversion: 2.1 time: 0.105362 Jun 01 04:40:18.290803 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 519/1055] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:18 2022] GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927 => generated 1185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:18.411889 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-fed408ef-68ee-4993-8b03-109fc9fc570d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:18.412526 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-fed408ef-68ee-4993-8b03-109fc9fc570d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:18.419388 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fed408ef-68ee-4993-8b03-109fc9fc570d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:18.419993 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fed408ef-68ee-4993-8b03-109fc9fc570d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:18.420701 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fed408ef-68ee-4993-8b03-109fc9fc570d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:18.421135 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fed408ef-68ee-4993-8b03-109fc9fc570d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:18.551407 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-fed408ef-68ee-4993-8b03-109fc9fc570d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:18.559473 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-fed408ef-68ee-4993-8b03-109fc9fc570d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1442 microversion: 2.1 time: 0.151401 Jun 01 04:40:18.560035 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 537/1056] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:18 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1442 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:40:18.576886 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-082871c1-082a-4671-8166-95a7d898dbdb tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:18.577499 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-082871c1-082a-4671-8166-95a7d898dbdb tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:18.584169 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-082871c1-082a-4671-8166-95a7d898dbdb tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:18.584619 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-082871c1-082a-4671-8166-95a7d898dbdb tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:18.585379 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-082871c1-082a-4671-8166-95a7d898dbdb tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:18.585814 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-082871c1-082a-4671-8166-95a7d898dbdb tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:18.719787 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-082871c1-082a-4671-8166-95a7d898dbdb tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:18.727352 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-082871c1-082a-4671-8166-95a7d898dbdb tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1442 microversion: 2.1 time: 0.155520 Jun 01 04:40:18.728430 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 520/1057] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:18 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1442 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:18.919219 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-2c94217f-0718-4f72-b437-6345d6a00c09 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:18.919855 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-2c94217f-0718-4f72-b437-6345d6a00c09 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: ebfba014-6e18-4a9b-a313-fb8d34eef6b0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:18.925863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2c94217f-0718-4f72-b437-6345d6a00c09 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:18.926304 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2c94217f-0718-4f72-b437-6345d6a00c09 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:18.927059 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2c94217f-0718-4f72-b437-6345d6a00c09 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:18.927520 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2c94217f-0718-4f72-b437-6345d6a00c09 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:19.064587 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-2c94217f-0718-4f72-b437-6345d6a00c09 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:19.072388 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-2c94217f-0718-4f72-b437-6345d6a00c09 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0" status: 200 len: 1314 microversion: 2.1 time: 0.157598 Jun 01 04:40:19.072967 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 538/1058] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:18 2022] GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:19.308417 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-09899415-f16b-485d-ac0e-f2a6ef30244b tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:19.309089 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-09899415-f16b-485d-ac0e-f2a6ef30244b tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: ae96e93e-9319-4283-91f7-c2474eeb9927] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:19.315473 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-09899415-f16b-485d-ac0e-f2a6ef30244b tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:19.315922 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-09899415-f16b-485d-ac0e-f2a6ef30244b tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:19.317122 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-09899415-f16b-485d-ac0e-f2a6ef30244b tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:19.317806 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-09899415-f16b-485d-ac0e-f2a6ef30244b tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:19.332104 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.wsgi [None req-09899415-f16b-485d-ac0e-f2a6ef30244b tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] HTTP exception thrown: Instance ae96e93e-9319-4283-91f7-c2474eeb9927 could not be found. Jun 01 04:40:19.334181 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-09899415-f16b-485d-ac0e-f2a6ef30244b tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Request method failure captured: Jun 01 04:40:19.334181 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: request: GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927 HTTP/1.1 Jun 01 04:40:19.334181 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept: application/json Jun 01 04:40:19.334181 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept-Encoding: identity Jun 01 04:40:19.334181 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Connection: close Jun 01 04:40:19.334181 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Length: 0 Jun 01 04:40:19.334181 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Type: application/json Jun 01 04:40:19.334181 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Host: 10.222.0.18 Jun 01 04:40:19.334181 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Openstack-System-Scope: None Jun 01 04:40:19.334181 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: User-Agent: python-urllib3/1.26.9 Jun 01 04:40:19.334181 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Auth-Token: gAAAAABilutmTuyqS9Q91ukdOnAjeU1dbTEQWa_t446Wl_uDjLoasN5Z33XdElRzzBdbMU0zO5IX31ix1vxYsAXmHYhfLPxNvuSwl0cyKLqqTZIi3wL_DQLWF21szLxLN53GzX9arTaIyPatIq4sLhTVbXl4sNVIIlvQ1gS_cTNbnQSq5AO5Pxo Jun 01 04:40:19.334181 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Id: None Jun 01 04:40:19.334181 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Name: None Jun 01 04:40:19.334181 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Identity-Status: Confirmed Jun 01 04:40:19.334181 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Is-Admin-Project: True Jun 01 04:40:19.334181 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Id: default Jun 01 04:40:19.334181 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Name: Default Jun 01 04:40:19.334181 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Id: 9369d530285849b3a9eac5e0034d3170 Jun 01 04:40:19.334181 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Name: tempest-TestVolumeBootPattern-161219860 Jun 01 04:40:19.334181 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Role: reader,member Jun 01 04:40:19.334181 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Roles: reader,member Jun 01 04:40:19.335999 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9369d530285849b3a9eac5e0034d3170"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9369d530285849b3a9eac5e0034d3170"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9369d530285849b3a9eac5e0034d3170"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9369d530285849b3a9eac5e0034d3170"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:40:19.335999 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant: tempest-TestVolumeBootPattern-161219860 Jun 01 04:40:19.335999 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Id: 9369d530285849b3a9eac5e0034d3170 Jun 01 04:40:19.335999 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Name: tempest-TestVolumeBootPattern-161219860 Jun 01 04:40:19.335999 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User: tempest-TestVolumeBootPattern-161219860-project Jun 01 04:40:19.335999 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Id: default Jun 01 04:40:19.335999 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Name: Default Jun 01 04:40:19.335999 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Id: c052b2f518064843928b4eff569e913f Jun 01 04:40:19.335999 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Name: tempest-TestVolumeBootPattern-161219860-project Jun 01 04:40:19.335999 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: method: > Jun 01 04:40:19.335999 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: exception: Instance ae96e93e-9319-4283-91f7-c2474eeb9927 could not be found. Jun 01 04:40:19.335999 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: action_args: {'id': 'ae96e93e-9319-4283-91f7-c2474eeb9927'} Jun 01 04:40:19.336986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:40:19.336986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:40:19.336986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:40:19.336986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:40:19.336986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:40:19.336986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:40:19.336986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:40:19.336986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:40:19.336986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:40:19.336986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:40:19.336986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae96e93e-9319-4283-91f7-c2474eeb9927 could not be found. Jun 01 04:40:19.336986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:40:19.336986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:40:19.336986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:40:19.336986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:40:19.336986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:40:19.336986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:40:19.336986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:40:19.336986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:40:19.336986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:40:19.339057 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:40:19.339057 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 01 04:40:19.339057 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 01 04:40:19.339057 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:40:19.339057 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:40:19.339057 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:40:19.339057 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:40:19.339057 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae96e93e-9319-4283-91f7-c2474eeb9927 could not be found. Jun 01 04:40:19.339057 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:40:19.339057 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:40:19.339057 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:40:19.339057 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:40:19.339057 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:40:19.339057 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:40:19.339057 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:40:19.339057 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:40:19.339057 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae96e93e-9319-4283-91f7-c2474eeb9927 could not be found. Jun 01 04:40:19.339057 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:40:19.343990 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-09899415-f16b-485d-ac0e-f2a6ef30244b tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Returning 404 to user: Instance ae96e93e-9319-4283-91f7-c2474eeb9927 could not be found. {{(pid=118517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:40:19.343990 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-09899415-f16b-485d-ac0e-f2a6ef30244b tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927" status: 404 len: 111 microversion: 2.1 time: 0.032763 Jun 01 04:40:19.343990 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 521/1059] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:19 2022] GET /compute/v2.1/servers/ae96e93e-9319-4283-91f7-c2474eeb9927 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:40:20.088607 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-4ae804bd-97aa-483a-9f7f-83b3f8d8bf3f tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:20.089255 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-4ae804bd-97aa-483a-9f7f-83b3f8d8bf3f tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: ebfba014-6e18-4a9b-a313-fb8d34eef6b0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:20.095930 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4ae804bd-97aa-483a-9f7f-83b3f8d8bf3f tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:20.096407 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4ae804bd-97aa-483a-9f7f-83b3f8d8bf3f tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:20.097205 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4ae804bd-97aa-483a-9f7f-83b3f8d8bf3f tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:20.097644 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4ae804bd-97aa-483a-9f7f-83b3f8d8bf3f tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:20.232616 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-4ae804bd-97aa-483a-9f7f-83b3f8d8bf3f tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:20.240342 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-4ae804bd-97aa-483a-9f7f-83b3f8d8bf3f tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0" status: 200 len: 1314 microversion: 2.1 time: 0.155447 Jun 01 04:40:20.240964 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 539/1060] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:20 2022] GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:20.979772 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-0f0d0058-be41-40b6-be60-3eeda36bbb3c req-8102837d-0a13-4905-b792-09a7661574b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba731766-ac3f-4564-8c8a-09a909595ea3", "tag": "642b3902-1011-48e3-b526-4497466efc94"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:40:20.988827 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-0f0d0058-be41-40b6-be60-3eeda36bbb3c req-8102837d-0a13-4905-b792-09a7661574b7 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:20.989590 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-0f0d0058-be41-40b6-be60-3eeda36bbb3c req-8102837d-0a13-4905-b792-09a7661574b7 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:21.003759 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-0f0d0058-be41-40b6-be60-3eeda36bbb3c req-8102837d-0a13-4905-b792-09a7661574b7 service nova] Creating event network-changed:642b3902-1011-48e3-b526-4497466efc94 for instance ba731766-ac3f-4564-8c8a-09a909595ea3 on hv-cinder-66710 Jun 01 04:40:21.010018 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-0f0d0058-be41-40b6-be60-3eeda36bbb3c req-8102837d-0a13-4905-b792-09a7661574b7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033440 Jun 01 04:40:21.010639 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 522/1061] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:40:21.260106 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-16fca736-bb83-44df-bb75-893cc6e8323b tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:21.260729 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-16fca736-bb83-44df-bb75-893cc6e8323b tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: ebfba014-6e18-4a9b-a313-fb8d34eef6b0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:21.267739 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-16fca736-bb83-44df-bb75-893cc6e8323b tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:21.268191 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-16fca736-bb83-44df-bb75-893cc6e8323b tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:21.268960 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-16fca736-bb83-44df-bb75-893cc6e8323b tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:21.269580 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-16fca736-bb83-44df-bb75-893cc6e8323b tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:21.416536 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-504760f4-eeac-42f3-b6d6-4220f94f91c1 req-ec24e687-3faf-413a-bebe-50a0f6fdc8e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebfba014-6e18-4a9b-a313-fb8d34eef6b0", "name": "network-vif-plugged", "status": "completed", "tag": "1f43de81-668e-4988-8403-8239559b3e47"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:40:21.427060 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-504760f4-eeac-42f3-b6d6-4220f94f91c1 req-ec24e687-3faf-413a-bebe-50a0f6fdc8e3 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:21.427883 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-504760f4-eeac-42f3-b6d6-4220f94f91c1 req-ec24e687-3faf-413a-bebe-50a0f6fdc8e3 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:21.442225 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-504760f4-eeac-42f3-b6d6-4220f94f91c1 req-ec24e687-3faf-413a-bebe-50a0f6fdc8e3 service nova] Creating event network-vif-plugged:1f43de81-668e-4988-8403-8239559b3e47 for instance ebfba014-6e18-4a9b-a313-fb8d34eef6b0 on hv-cinder-66710 Jun 01 04:40:21.449109 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-504760f4-eeac-42f3-b6d6-4220f94f91c1 req-ec24e687-3faf-413a-bebe-50a0f6fdc8e3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041312 Jun 01 04:40:21.450040 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 523/1062] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:40:21.481673 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-16fca736-bb83-44df-bb75-893cc6e8323b tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:21.492312 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-16fca736-bb83-44df-bb75-893cc6e8323b tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0" status: 200 len: 1314 microversion: 2.1 time: 0.237876 Jun 01 04:40:21.493024 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 540/1063] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:21 2022] GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:22.511165 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-79b1af0c-7ccf-4971-b27e-96da7f14fa9a tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:22.511816 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-79b1af0c-7ccf-4971-b27e-96da7f14fa9a tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: ebfba014-6e18-4a9b-a313-fb8d34eef6b0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:22.518815 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-79b1af0c-7ccf-4971-b27e-96da7f14fa9a tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:22.519187 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-79b1af0c-7ccf-4971-b27e-96da7f14fa9a tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:22.520003 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-79b1af0c-7ccf-4971-b27e-96da7f14fa9a tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:22.520439 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-79b1af0c-7ccf-4971-b27e-96da7f14fa9a tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:22.693796 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-79b1af0c-7ccf-4971-b27e-96da7f14fa9a tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:22.701973 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-79b1af0c-7ccf-4971-b27e-96da7f14fa9a tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0" status: 200 len: 1314 microversion: 2.1 time: 0.195688 Jun 01 04:40:22.702569 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 524/1064] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:22 2022] GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:23.065397 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-6b233bf9-184c-4f4b-a847-9151c3844342 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:23.065959 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-6b233bf9-184c-4f4b-a847-9151c3844342 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:23.068950 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-5e16dda9-d6d1-4daf-b941-e1c9c3c7caf9 req-89eea020-01f0-4622-b75f-62abd83bccd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cc59b84-5abc-477a-bcab-4bb682e2cfda", "tag": "37997631-7c0b-45f2-8dde-80c75b82d919"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:40:23.072870 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6b233bf9-184c-4f4b-a847-9151c3844342 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:23.073328 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6b233bf9-184c-4f4b-a847-9151c3844342 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:23.074297 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6b233bf9-184c-4f4b-a847-9151c3844342 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:23.074739 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-6b233bf9-184c-4f4b-a847-9151c3844342 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:23.078745 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-5e16dda9-d6d1-4daf-b941-e1c9c3c7caf9 req-89eea020-01f0-4622-b75f-62abd83bccd7 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:23.079288 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-5e16dda9-d6d1-4daf-b941-e1c9c3c7caf9 req-89eea020-01f0-4622-b75f-62abd83bccd7 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:23.091844 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-5e16dda9-d6d1-4daf-b941-e1c9c3c7caf9 req-89eea020-01f0-4622-b75f-62abd83bccd7 service nova] Creating event network-changed:37997631-7c0b-45f2-8dde-80c75b82d919 for instance 4cc59b84-5abc-477a-bcab-4bb682e2cfda on hv-cinder-66710 Jun 01 04:40:23.097580 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-5e16dda9-d6d1-4daf-b941-e1c9c3c7caf9 req-89eea020-01f0-4622-b75f-62abd83bccd7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033431 Jun 01 04:40:23.098181 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 525/1065] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:40:23.101410 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-6b233bf9-184c-4f4b-a847-9151c3844342 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Going to try to terminate instance {{(pid=118516) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 01 04:40:23.220900 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:40:23.496500 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-6b233bf9-184c-4f4b-a847-9151c3844342 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 204 len: 0 microversion: 2.1 time: 0.434620 Jun 01 04:40:23.497082 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 541/1066] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 1 04:40:23 2022] DELETE /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 01 04:40:23.506429 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a7ca0003-c917-40b2-80e7-6387f9674c6a tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:23.507132 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-a7ca0003-c917-40b2-80e7-6387f9674c6a tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:23.513930 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a7ca0003-c917-40b2-80e7-6387f9674c6a tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:23.515196 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a7ca0003-c917-40b2-80e7-6387f9674c6a tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:23.516039 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a7ca0003-c917-40b2-80e7-6387f9674c6a tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:23.516491 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a7ca0003-c917-40b2-80e7-6387f9674c6a tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:23.661357 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-a7ca0003-c917-40b2-80e7-6387f9674c6a tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:23.669955 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-a7ca0003-c917-40b2-80e7-6387f9674c6a tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1576 microversion: 2.1 time: 0.168152 Jun 01 04:40:23.679867 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 526/1067] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:23 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1576 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:23.721476 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-41dc09a7-1c3a-41ce-90fb-fee68d552bcf tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:23.721476 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-41dc09a7-1c3a-41ce-90fb-fee68d552bcf tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: ebfba014-6e18-4a9b-a313-fb8d34eef6b0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:23.727446 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-41dc09a7-1c3a-41ce-90fb-fee68d552bcf tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:23.728040 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-41dc09a7-1c3a-41ce-90fb-fee68d552bcf tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:23.729327 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-41dc09a7-1c3a-41ce-90fb-fee68d552bcf tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:23.730034 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-41dc09a7-1c3a-41ce-90fb-fee68d552bcf tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:23.875452 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-41dc09a7-1c3a-41ce-90fb-fee68d552bcf tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:23.883148 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-41dc09a7-1c3a-41ce-90fb-fee68d552bcf tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0" status: 200 len: 1314 microversion: 2.1 time: 0.167198 Jun 01 04:40:23.883758 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 542/1068] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:23 2022] GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:24.687089 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-1bdb6b3b-c0bf-4cec-97b8-9df34ce3f66d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:24.687706 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-1bdb6b3b-c0bf-4cec-97b8-9df34ce3f66d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:24.694122 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1bdb6b3b-c0bf-4cec-97b8-9df34ce3f66d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:24.694560 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1bdb6b3b-c0bf-4cec-97b8-9df34ce3f66d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:24.695325 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1bdb6b3b-c0bf-4cec-97b8-9df34ce3f66d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:24.695773 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1bdb6b3b-c0bf-4cec-97b8-9df34ce3f66d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:24.840787 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-1bdb6b3b-c0bf-4cec-97b8-9df34ce3f66d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:24.848787 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-1bdb6b3b-c0bf-4cec-97b8-9df34ce3f66d tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1576 microversion: 2.1 time: 0.165499 Jun 01 04:40:24.849353 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 527/1069] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:24 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:24.900887 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-f1dc1fd5-164e-4d7a-b525-5a6759b1df4f tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:24.901498 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-f1dc1fd5-164e-4d7a-b525-5a6759b1df4f tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: ebfba014-6e18-4a9b-a313-fb8d34eef6b0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:24.908392 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f1dc1fd5-164e-4d7a-b525-5a6759b1df4f tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:24.908838 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f1dc1fd5-164e-4d7a-b525-5a6759b1df4f tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:24.909608 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f1dc1fd5-164e-4d7a-b525-5a6759b1df4f tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:24.910088 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f1dc1fd5-164e-4d7a-b525-5a6759b1df4f tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:25.046788 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-f1dc1fd5-164e-4d7a-b525-5a6759b1df4f tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:25.054700 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-f1dc1fd5-164e-4d7a-b525-5a6759b1df4f tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0" status: 200 len: 1499 microversion: 2.1 time: 0.158636 Jun 01 04:40:25.055287 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 543/1070] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:24 2022] GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0 => generated 1499 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:25.865727 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-85fd30d3-c5d0-4800-b1ae-a6874360125c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:25.866471 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-85fd30d3-c5d0-4800-b1ae-a6874360125c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:25.873143 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-85fd30d3-c5d0-4800-b1ae-a6874360125c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:25.873646 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-85fd30d3-c5d0-4800-b1ae-a6874360125c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:25.874462 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-85fd30d3-c5d0-4800-b1ae-a6874360125c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:25.875084 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-85fd30d3-c5d0-4800-b1ae-a6874360125c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:26.002103 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-248c3fa3-6c09-41e2-aa8a-b19fbd4d2b32 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:26.002746 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-248c3fa3-6c09-41e2-aa8a-b19fbd4d2b32 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: ebfba014-6e18-4a9b-a313-fb8d34eef6b0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:26.009848 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-248c3fa3-6c09-41e2-aa8a-b19fbd4d2b32 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:26.010375 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-248c3fa3-6c09-41e2-aa8a-b19fbd4d2b32 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:26.011352 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-248c3fa3-6c09-41e2-aa8a-b19fbd4d2b32 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:26.011791 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-248c3fa3-6c09-41e2-aa8a-b19fbd4d2b32 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:26.020115 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-85fd30d3-c5d0-4800-b1ae-a6874360125c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:26.028947 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-85fd30d3-c5d0-4800-b1ae-a6874360125c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1457 microversion: 2.1 time: 0.167087 Jun 01 04:40:26.029525 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 528/1071] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:25 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1457 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:26.053503 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-248c3fa3-6c09-41e2-aa8a-b19fbd4d2b32 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: ebfba014-6e18-4a9b-a313-fb8d34eef6b0] Going to try to terminate instance {{(pid=118516) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 01 04:40:26.149144 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-aece7aea-dc83-4df8-9a73-4837caea1139 req-1f144b42-fedb-42d8-9d4c-4f393d21e4e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc59b84-5abc-477a-bcab-4bb682e2cfda", "name": "network-vif-deleted", "tag": "37997631-7c0b-45f2-8dde-80c75b82d919"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:40:26.157704 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-aece7aea-dc83-4df8-9a73-4837caea1139 req-1f144b42-fedb-42d8-9d4c-4f393d21e4e1 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:26.158184 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-aece7aea-dc83-4df8-9a73-4837caea1139 req-1f144b42-fedb-42d8-9d4c-4f393d21e4e1 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:26.169110 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-aece7aea-dc83-4df8-9a73-4837caea1139 req-1f144b42-fedb-42d8-9d4c-4f393d21e4e1 service nova] Creating event network-vif-deleted:37997631-7c0b-45f2-8dde-80c75b82d919 for instance 4cc59b84-5abc-477a-bcab-4bb682e2cfda on hv-cinder-66710 Jun 01 04:40:26.174138 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-aece7aea-dc83-4df8-9a73-4837caea1139 req-1f144b42-fedb-42d8-9d4c-4f393d21e4e1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029255 Jun 01 04:40:26.174729 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 529/1072] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:40:26.341866 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-248c3fa3-6c09-41e2-aa8a-b19fbd4d2b32 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0" status: 204 len: 0 microversion: 2.1 time: 0.343440 Jun 01 04:40:26.345502 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 544/1073] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 1 04:40:25 2022] DELETE /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 01 04:40:26.352650 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-fa96d307-d602-43b0-ada3-9a0a5f05c036 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:26.353476 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-fa96d307-d602-43b0-ada3-9a0a5f05c036 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: ebfba014-6e18-4a9b-a313-fb8d34eef6b0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:26.360317 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-fa96d307-d602-43b0-ada3-9a0a5f05c036 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:26.360758 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-fa96d307-d602-43b0-ada3-9a0a5f05c036 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:26.361518 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-fa96d307-d602-43b0-ada3-9a0a5f05c036 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:26.362090 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-fa96d307-d602-43b0-ada3-9a0a5f05c036 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:26.502171 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-fa96d307-d602-43b0-ada3-9a0a5f05c036 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:26.510529 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-fa96d307-d602-43b0-ada3-9a0a5f05c036 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0" status: 200 len: 1505 microversion: 2.1 time: 0.163336 Jun 01 04:40:26.511199 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 530/1074] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:26 2022] GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0 => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:27.046672 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d2c82664-2076-4579-8f11-8eda66134066 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:27.047398 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-d2c82664-2076-4579-8f11-8eda66134066 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:27.049789 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:40:27.054673 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d2c82664-2076-4579-8f11-8eda66134066 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:27.055126 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d2c82664-2076-4579-8f11-8eda66134066 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:27.055960 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d2c82664-2076-4579-8f11-8eda66134066 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:27.056403 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d2c82664-2076-4579-8f11-8eda66134066 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:27.122800 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-d2c82664-2076-4579-8f11-8eda66134066 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:27.130911 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-d2c82664-2076-4579-8f11-8eda66134066 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1225 microversion: 2.1 time: 0.088486 Jun 01 04:40:27.131497 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 545/1075] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:27 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:27.527768 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-ad6f4d7c-9a7c-4ccf-ae0b-d8ad3ad44c59 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:27.528360 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-ad6f4d7c-9a7c-4ccf-ae0b-d8ad3ad44c59 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: ebfba014-6e18-4a9b-a313-fb8d34eef6b0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:27.534891 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ad6f4d7c-9a7c-4ccf-ae0b-d8ad3ad44c59 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:27.535365 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ad6f4d7c-9a7c-4ccf-ae0b-d8ad3ad44c59 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:27.536124 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ad6f4d7c-9a7c-4ccf-ae0b-d8ad3ad44c59 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:27.536558 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ad6f4d7c-9a7c-4ccf-ae0b-d8ad3ad44c59 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:27.671350 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-ad6f4d7c-9a7c-4ccf-ae0b-d8ad3ad44c59 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:27.679031 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-ad6f4d7c-9a7c-4ccf-ae0b-d8ad3ad44c59 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0" status: 200 len: 1505 microversion: 2.1 time: 0.155191 Jun 01 04:40:27.679637 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 531/1076] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:27 2022] GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:28.148316 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-0892e8fd-620f-4fa3-9928-9d0882ce39f6 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:28.148935 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-0892e8fd-620f-4fa3-9928-9d0882ce39f6 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:28.156510 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0892e8fd-620f-4fa3-9928-9d0882ce39f6 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:28.156967 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0892e8fd-620f-4fa3-9928-9d0882ce39f6 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:28.157732 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0892e8fd-620f-4fa3-9928-9d0882ce39f6 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:28.158168 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0892e8fd-620f-4fa3-9928-9d0882ce39f6 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:28.189026 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0892e8fd-620f-4fa3-9928-9d0882ce39f6 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:28.189482 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0892e8fd-620f-4fa3-9928-9d0882ce39f6 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:28.189929 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.objects.instance [None req-0892e8fd-620f-4fa3-9928-9d0882ce39f6 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lazy-loading 'fault' on Instance uuid 4cc59b84-5abc-477a-bcab-4bb682e2cfda {{(pid=118516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:40:28.229994 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-0892e8fd-620f-4fa3-9928-9d0882ce39f6 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c052b2f518064843928b4eff569e913f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9369d530285849b3a9eac5e0034d3170', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:28.238547 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-0892e8fd-620f-4fa3-9928-9d0882ce39f6 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 200 len: 1230 microversion: 2.1 time: 0.094077 Jun 01 04:40:28.239112 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 546/1077] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:28 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 1230 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:28.696509 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-b0ff721c-6ae5-4906-9f29-55fb4fa5a3a4 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:28.697124 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-b0ff721c-6ae5-4906-9f29-55fb4fa5a3a4 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: ebfba014-6e18-4a9b-a313-fb8d34eef6b0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:28.704856 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b0ff721c-6ae5-4906-9f29-55fb4fa5a3a4 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:28.705353 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b0ff721c-6ae5-4906-9f29-55fb4fa5a3a4 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:28.706136 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b0ff721c-6ae5-4906-9f29-55fb4fa5a3a4 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:28.706577 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b0ff721c-6ae5-4906-9f29-55fb4fa5a3a4 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:28.854860 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-b0ff721c-6ae5-4906-9f29-55fb4fa5a3a4 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:28.863770 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-b0ff721c-6ae5-4906-9f29-55fb4fa5a3a4 tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0" status: 200 len: 1505 microversion: 2.1 time: 0.171063 Jun 01 04:40:28.864657 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 532/1078] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:28 2022] GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0 => generated 1505 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:40:28.885788 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-f81d7a4b-e0c4-4462-b610-4a39981c64b2 req-507d485b-3a42-470d-9ca9-ac322fa23487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebfba014-6e18-4a9b-a313-fb8d34eef6b0", "name": "network-vif-deleted", "tag": "1f43de81-668e-4988-8403-8239559b3e47"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:40:28.894470 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-f81d7a4b-e0c4-4462-b610-4a39981c64b2 req-507d485b-3a42-470d-9ca9-ac322fa23487 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:28.894920 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-f81d7a4b-e0c4-4462-b610-4a39981c64b2 req-507d485b-3a42-470d-9ca9-ac322fa23487 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:28.906572 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-f81d7a4b-e0c4-4462-b610-4a39981c64b2 req-507d485b-3a42-470d-9ca9-ac322fa23487 service nova] Creating event network-vif-deleted:1f43de81-668e-4988-8403-8239559b3e47 for instance ebfba014-6e18-4a9b-a313-fb8d34eef6b0 on hv-cinder-66710 Jun 01 04:40:28.911475 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-f81d7a4b-e0c4-4462-b610-4a39981c64b2 req-507d485b-3a42-470d-9ca9-ac322fa23487 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029446 Jun 01 04:40:28.912268 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 547/1079] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:40:29.255569 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-1e3f1f8b-88d4-453c-b577-a5be0279a7f5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:29.256631 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-1e3f1f8b-88d4-453c-b577-a5be0279a7f5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: 4cc59b84-5abc-477a-bcab-4bb682e2cfda] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:29.265686 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1e3f1f8b-88d4-453c-b577-a5be0279a7f5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:29.266439 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1e3f1f8b-88d4-453c-b577-a5be0279a7f5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:29.267728 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1e3f1f8b-88d4-453c-b577-a5be0279a7f5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:29.268441 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1e3f1f8b-88d4-453c-b577-a5be0279a7f5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:29.284461 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.wsgi [None req-1e3f1f8b-88d4-453c-b577-a5be0279a7f5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] HTTP exception thrown: Instance 4cc59b84-5abc-477a-bcab-4bb682e2cfda could not be found. Jun 01 04:40:29.286849 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-1e3f1f8b-88d4-453c-b577-a5be0279a7f5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Request method failure captured: Jun 01 04:40:29.286849 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: request: GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda HTTP/1.1 Jun 01 04:40:29.286849 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept: application/json Jun 01 04:40:29.286849 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept-Encoding: identity Jun 01 04:40:29.286849 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Connection: close Jun 01 04:40:29.286849 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Length: 0 Jun 01 04:40:29.286849 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Type: application/json Jun 01 04:40:29.286849 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Host: 10.222.0.18 Jun 01 04:40:29.286849 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Openstack-System-Scope: None Jun 01 04:40:29.286849 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: User-Agent: python-urllib3/1.26.9 Jun 01 04:40:29.286849 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Auth-Token: gAAAAABilutmTuyqS9Q91ukdOnAjeU1dbTEQWa_t446Wl_uDjLoasN5Z33XdElRzzBdbMU0zO5IX31ix1vxYsAXmHYhfLPxNvuSwl0cyKLqqTZIi3wL_DQLWF21szLxLN53GzX9arTaIyPatIq4sLhTVbXl4sNVIIlvQ1gS_cTNbnQSq5AO5Pxo Jun 01 04:40:29.286849 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Id: None Jun 01 04:40:29.286849 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Name: None Jun 01 04:40:29.286849 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Identity-Status: Confirmed Jun 01 04:40:29.286849 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Is-Admin-Project: True Jun 01 04:40:29.286849 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Id: default Jun 01 04:40:29.286849 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Name: Default Jun 01 04:40:29.286849 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Id: 9369d530285849b3a9eac5e0034d3170 Jun 01 04:40:29.286849 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Name: tempest-TestVolumeBootPattern-161219860 Jun 01 04:40:29.286849 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Role: reader,member Jun 01 04:40:29.286849 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Roles: reader,member Jun 01 04:40:29.288596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9369d530285849b3a9eac5e0034d3170"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9369d530285849b3a9eac5e0034d3170"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9369d530285849b3a9eac5e0034d3170"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9369d530285849b3a9eac5e0034d3170"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:40:29.288596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant: tempest-TestVolumeBootPattern-161219860 Jun 01 04:40:29.288596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Id: 9369d530285849b3a9eac5e0034d3170 Jun 01 04:40:29.288596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Name: tempest-TestVolumeBootPattern-161219860 Jun 01 04:40:29.288596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User: tempest-TestVolumeBootPattern-161219860-project Jun 01 04:40:29.288596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Id: default Jun 01 04:40:29.288596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Name: Default Jun 01 04:40:29.288596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Id: c052b2f518064843928b4eff569e913f Jun 01 04:40:29.288596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Name: tempest-TestVolumeBootPattern-161219860-project Jun 01 04:40:29.288596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: method: > Jun 01 04:40:29.288596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: exception: Instance 4cc59b84-5abc-477a-bcab-4bb682e2cfda could not be found. Jun 01 04:40:29.288596 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: action_args: {'id': '4cc59b84-5abc-477a-bcab-4bb682e2cfda'} Jun 01 04:40:29.289555 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:40:29.289555 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:40:29.289555 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:40:29.289555 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:40:29.289555 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:40:29.289555 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:40:29.289555 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:40:29.289555 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:40:29.289555 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:40:29.289555 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:40:29.289555 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cc59b84-5abc-477a-bcab-4bb682e2cfda could not be found. Jun 01 04:40:29.289555 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:40:29.289555 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:40:29.289555 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:40:29.289555 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:40:29.289555 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:40:29.289555 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:40:29.289555 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:40:29.289555 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:40:29.289555 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:40:29.291267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:40:29.291267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 01 04:40:29.291267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 01 04:40:29.291267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:40:29.291267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:40:29.291267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:40:29.291267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:40:29.291267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cc59b84-5abc-477a-bcab-4bb682e2cfda could not be found. Jun 01 04:40:29.291267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:40:29.291267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:40:29.291267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:40:29.291267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:40:29.291267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:40:29.291267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:40:29.291267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:40:29.291267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:40:29.291267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cc59b84-5abc-477a-bcab-4bb682e2cfda could not be found. Jun 01 04:40:29.291267 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:40:29.292736 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-1e3f1f8b-88d4-453c-b577-a5be0279a7f5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Returning 404 to user: Instance 4cc59b84-5abc-477a-bcab-4bb682e2cfda could not be found. {{(pid=118517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:40:29.292736 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-1e3f1f8b-88d4-453c-b577-a5be0279a7f5 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda" status: 404 len: 111 microversion: 2.1 time: 0.036091 Jun 01 04:40:29.292736 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 533/1080] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:29 2022] GET /compute/v2.1/servers/4cc59b84-5abc-477a-bcab-4bb682e2cfda => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:40:29.869824 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-a2e969f8-c0ce-4c79-b583-933d98f9c35c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:29.869824 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-a2e969f8-c0ce-4c79-b583-933d98f9c35c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:29.869824 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a2e969f8-c0ce-4c79-b583-933d98f9c35c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:29.869824 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a2e969f8-c0ce-4c79-b583-933d98f9c35c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:29.870587 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a2e969f8-c0ce-4c79-b583-933d98f9c35c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:29.870587 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a2e969f8-c0ce-4c79-b583-933d98f9c35c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:29.881836 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-97e1b728-5062-4c23-b8f0-f9ddce5914ea tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:29.882519 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.wsgi [None req-a2e969f8-c0ce-4c79-b583-933d98f9c35c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] HTTP exception thrown: Instance a724f928-21b8-4379-a078-600dc46ce06e could not be found. Jun 01 04:40:29.883350 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-97e1b728-5062-4c23-b8f0-f9ddce5914ea tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: ebfba014-6e18-4a9b-a313-fb8d34eef6b0] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:29.884043 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-a2e969f8-c0ce-4c79-b583-933d98f9c35c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Request method failure captured: Jun 01 04:40:29.884043 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: request: DELETE /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e HTTP/1.1 Jun 01 04:40:29.884043 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept: application/json Jun 01 04:40:29.884043 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept-Encoding: identity Jun 01 04:40:29.884043 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Connection: close Jun 01 04:40:29.884043 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Length: 0 Jun 01 04:40:29.884043 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Type: application/json Jun 01 04:40:29.884043 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Host: 10.222.0.18 Jun 01 04:40:29.884043 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Openstack-System-Scope: None Jun 01 04:40:29.884043 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: User-Agent: python-urllib3/1.26.9 Jun 01 04:40:29.884043 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Auth-Token: gAAAAABilutmTuyqS9Q91ukdOnAjeU1dbTEQWa_t446Wl_uDjLoasN5Z33XdElRzzBdbMU0zO5IX31ix1vxYsAXmHYhfLPxNvuSwl0cyKLqqTZIi3wL_DQLWF21szLxLN53GzX9arTaIyPatIq4sLhTVbXl4sNVIIlvQ1gS_cTNbnQSq5AO5Pxo Jun 01 04:40:29.884043 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Id: None Jun 01 04:40:29.884043 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Name: None Jun 01 04:40:29.884043 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Identity-Status: Confirmed Jun 01 04:40:29.884043 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Is-Admin-Project: True Jun 01 04:40:29.884043 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Id: default Jun 01 04:40:29.884043 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Name: Default Jun 01 04:40:29.884043 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Id: 9369d530285849b3a9eac5e0034d3170 Jun 01 04:40:29.884043 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Name: tempest-TestVolumeBootPattern-161219860 Jun 01 04:40:29.884043 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Role: reader,member Jun 01 04:40:29.884043 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Roles: reader,member Jun 01 04:40:29.885494 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9369d530285849b3a9eac5e0034d3170"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9369d530285849b3a9eac5e0034d3170"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9369d530285849b3a9eac5e0034d3170"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9369d530285849b3a9eac5e0034d3170"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:40:29.885494 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant: tempest-TestVolumeBootPattern-161219860 Jun 01 04:40:29.885494 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Id: 9369d530285849b3a9eac5e0034d3170 Jun 01 04:40:29.885494 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Name: tempest-TestVolumeBootPattern-161219860 Jun 01 04:40:29.885494 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User: tempest-TestVolumeBootPattern-161219860-project Jun 01 04:40:29.885494 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Id: default Jun 01 04:40:29.885494 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Name: Default Jun 01 04:40:29.885494 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Id: c052b2f518064843928b4eff569e913f Jun 01 04:40:29.885494 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Name: tempest-TestVolumeBootPattern-161219860-project Jun 01 04:40:29.885494 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: method: > Jun 01 04:40:29.885494 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: exception: Instance a724f928-21b8-4379-a078-600dc46ce06e could not be found. Jun 01 04:40:29.885494 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: action_args: {'id': 'a724f928-21b8-4379-a078-600dc46ce06e'} Jun 01 04:40:29.886268 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:40:29.886268 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:40:29.886268 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:40:29.886268 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:40:29.886268 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:40:29.886268 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:40:29.886268 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:40:29.886268 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:40:29.886268 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:40:29.886268 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:40:29.886268 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a724f928-21b8-4379-a078-600dc46ce06e could not be found. Jun 01 04:40:29.886268 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:40:29.886268 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:40:29.886268 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:40:29.886268 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:40:29.886268 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:40:29.886268 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:40:29.886268 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:40:29.886268 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:40:29.886268 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:40:29.896140 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:40:29.896140 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 01 04:40:29.896140 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 01 04:40:29.896140 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 01 04:40:29.896140 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 01 04:40:29.896140 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:40:29.896140 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:40:29.896140 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:40:29.896140 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:40:29.896140 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a724f928-21b8-4379-a078-600dc46ce06e could not be found. Jun 01 04:40:29.896140 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:40:29.896140 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:40:29.896140 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:40:29.896140 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:40:29.896140 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:40:29.896140 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:40:29.896140 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:40:29.896140 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:40:29.896140 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a724f928-21b8-4379-a078-600dc46ce06e could not be found. Jun 01 04:40:29.896140 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:40:29.897428 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-a2e969f8-c0ce-4c79-b583-933d98f9c35c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Returning 404 to user: Instance a724f928-21b8-4379-a078-600dc46ce06e could not be found. {{(pid=118516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:40:29.897428 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-a2e969f8-c0ce-4c79-b583-933d98f9c35c tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e" status: 404 len: 111 microversion: 2.1 time: 0.030597 Jun 01 04:40:29.897428 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 548/1081] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 1 04:40:29 2022] DELETE /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:40:29.897664 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-97e1b728-5062-4c23-b8f0-f9ddce5914ea tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:29.897664 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-97e1b728-5062-4c23-b8f0-f9ddce5914ea tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:29.897664 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-97e1b728-5062-4c23-b8f0-f9ddce5914ea tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:29.897664 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-97e1b728-5062-4c23-b8f0-f9ddce5914ea tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:29.897966 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-74ce4c02-ae34-42e4-933a-8662ecd15764 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:29.897966 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-74ce4c02-ae34-42e4-933a-8662ecd15764 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] [instance: a724f928-21b8-4379-a078-600dc46ce06e] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:29.900979 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-74ce4c02-ae34-42e4-933a-8662ecd15764 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:29.901429 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-74ce4c02-ae34-42e4-933a-8662ecd15764 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:29.902819 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-74ce4c02-ae34-42e4-933a-8662ecd15764 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:29.903257 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-74ce4c02-ae34-42e4-933a-8662ecd15764 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:29.917754 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.wsgi [None req-74ce4c02-ae34-42e4-933a-8662ecd15764 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] HTTP exception thrown: Instance a724f928-21b8-4379-a078-600dc46ce06e could not be found. Jun 01 04:40:29.919368 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-74ce4c02-ae34-42e4-933a-8662ecd15764 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Request method failure captured: Jun 01 04:40:29.919368 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: request: GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e HTTP/1.1 Jun 01 04:40:29.919368 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept: application/json Jun 01 04:40:29.919368 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept-Encoding: identity Jun 01 04:40:29.919368 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Connection: close Jun 01 04:40:29.919368 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Length: 0 Jun 01 04:40:29.919368 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Type: application/json Jun 01 04:40:29.919368 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Host: 10.222.0.18 Jun 01 04:40:29.919368 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Openstack-System-Scope: None Jun 01 04:40:29.919368 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: User-Agent: python-urllib3/1.26.9 Jun 01 04:40:29.919368 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Auth-Token: gAAAAABilutmTuyqS9Q91ukdOnAjeU1dbTEQWa_t446Wl_uDjLoasN5Z33XdElRzzBdbMU0zO5IX31ix1vxYsAXmHYhfLPxNvuSwl0cyKLqqTZIi3wL_DQLWF21szLxLN53GzX9arTaIyPatIq4sLhTVbXl4sNVIIlvQ1gS_cTNbnQSq5AO5Pxo Jun 01 04:40:29.919368 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Id: None Jun 01 04:40:29.919368 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Name: None Jun 01 04:40:29.919368 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Identity-Status: Confirmed Jun 01 04:40:29.919368 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Is-Admin-Project: True Jun 01 04:40:29.919368 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Id: default Jun 01 04:40:29.919368 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Name: Default Jun 01 04:40:29.919368 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Id: 9369d530285849b3a9eac5e0034d3170 Jun 01 04:40:29.919368 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Name: tempest-TestVolumeBootPattern-161219860 Jun 01 04:40:29.919368 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Role: reader,member Jun 01 04:40:29.919368 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Roles: reader,member Jun 01 04:40:29.920874 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9369d530285849b3a9eac5e0034d3170"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9369d530285849b3a9eac5e0034d3170"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9369d530285849b3a9eac5e0034d3170"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9369d530285849b3a9eac5e0034d3170"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:40:29.920874 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant: tempest-TestVolumeBootPattern-161219860 Jun 01 04:40:29.920874 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Id: 9369d530285849b3a9eac5e0034d3170 Jun 01 04:40:29.920874 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Name: tempest-TestVolumeBootPattern-161219860 Jun 01 04:40:29.920874 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User: tempest-TestVolumeBootPattern-161219860-project Jun 01 04:40:29.920874 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Id: default Jun 01 04:40:29.920874 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Name: Default Jun 01 04:40:29.920874 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Id: c052b2f518064843928b4eff569e913f Jun 01 04:40:29.920874 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Name: tempest-TestVolumeBootPattern-161219860-project Jun 01 04:40:29.920874 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: method: > Jun 01 04:40:29.920874 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: exception: Instance a724f928-21b8-4379-a078-600dc46ce06e could not be found. Jun 01 04:40:29.920874 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: action_args: {'id': 'a724f928-21b8-4379-a078-600dc46ce06e'} Jun 01 04:40:29.921631 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:40:29.921631 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:40:29.921631 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:40:29.921631 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:40:29.921631 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:40:29.921631 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:40:29.921631 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:40:29.921631 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:40:29.921631 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:40:29.921631 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:40:29.921631 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a724f928-21b8-4379-a078-600dc46ce06e could not be found. Jun 01 04:40:29.921631 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:40:29.921631 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:40:29.921631 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:40:29.921631 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:40:29.921631 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:40:29.921631 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:40:29.921631 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:40:29.921631 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:40:29.921631 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:40:29.922855 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:40:29.922855 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 01 04:40:29.922855 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 01 04:40:29.922855 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:40:29.922855 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:40:29.922855 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:40:29.922855 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:40:29.922855 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a724f928-21b8-4379-a078-600dc46ce06e could not be found. Jun 01 04:40:29.922855 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:40:29.922855 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:40:29.922855 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:40:29.922855 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:40:29.922855 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:40:29.922855 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:40:29.922855 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:40:29.922855 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:40:29.922855 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a724f928-21b8-4379-a078-600dc46ce06e could not be found. Jun 01 04:40:29.922855 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:40:29.924738 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-74ce4c02-ae34-42e4-933a-8662ecd15764 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Returning 404 to user: Instance a724f928-21b8-4379-a078-600dc46ce06e could not be found. {{(pid=118516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:40:29.925361 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-74ce4c02-ae34-42e4-933a-8662ecd15764 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e" status: 404 len: 111 microversion: 2.1 time: 0.034715 Jun 01 04:40:29.926113 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 549/1082] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:29 2022] GET /compute/v2.1/servers/a724f928-21b8-4379-a078-600dc46ce06e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 01 04:40:29.929012 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-97e1b728-5062-4c23-b8f0-f9ddce5914ea tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:29.929573 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-97e1b728-5062-4c23-b8f0-f9ddce5914ea tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:29.930227 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.objects.instance [None req-97e1b728-5062-4c23-b8f0-f9ddce5914ea tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lazy-loading 'fault' on Instance uuid ebfba014-6e18-4a9b-a313-fb8d34eef6b0 {{(pid=118517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:40:29.977784 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-97e1b728-5062-4c23-b8f0-f9ddce5914ea tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b97ad4fa674391a99cf97bc10da8bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607408c2a46439d93026002d312b9de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:40:29.986595 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-97e1b728-5062-4c23-b8f0-f9ddce5914ea tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0" status: 200 len: 1304 microversion: 2.1 time: 0.108558 Jun 01 04:40:29.987177 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 534/1083] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:29 2022] GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0 => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:40:31.007782 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d14eeba1-ad22-495a-875c-45b8056523cf tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:31.008397 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-d14eeba1-ad22-495a-875c-45b8056523cf tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] [instance: ebfba014-6e18-4a9b-a313-fb8d34eef6b0] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:40:31.015170 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d14eeba1-ad22-495a-875c-45b8056523cf tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:31.021379 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d14eeba1-ad22-495a-875c-45b8056523cf tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:31.021379 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d14eeba1-ad22-495a-875c-45b8056523cf tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:40:31.021379 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d14eeba1-ad22-495a-875c-45b8056523cf tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:40:31.032936 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.wsgi [None req-d14eeba1-ad22-495a-875c-45b8056523cf tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] HTTP exception thrown: Instance ebfba014-6e18-4a9b-a313-fb8d34eef6b0 could not be found. Jun 01 04:40:31.034449 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d14eeba1-ad22-495a-875c-45b8056523cf tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Request method failure captured: Jun 01 04:40:31.034449 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: request: GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0 HTTP/1.1 Jun 01 04:40:31.034449 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept: application/json Jun 01 04:40:31.034449 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept-Encoding: identity Jun 01 04:40:31.034449 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Connection: close Jun 01 04:40:31.034449 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Length: 0 Jun 01 04:40:31.034449 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Type: application/json Jun 01 04:40:31.034449 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Host: 10.222.0.18 Jun 01 04:40:31.034449 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Openstack-System-Scope: None Jun 01 04:40:31.034449 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: User-Agent: python-urllib3/1.26.9 Jun 01 04:40:31.034449 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Auth-Token: gAAAAABilu2QrNoxHVM8cbw13Io70lMaErbilQ02-vx6Iknl0MQc8BZXvmnARXKQ4dhHy4JR_l-zbc9rRUHVC_47sxCOA9w1bgTdnPPLNfGghnEEVHxd7oINrTG65qXeRCSLzBx4SU3TpSUZz3LStl_jzglf594NPZ12d7S0QTZbME2_FXhHBEA Jun 01 04:40:31.034449 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Id: None Jun 01 04:40:31.034449 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Name: None Jun 01 04:40:31.034449 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Identity-Status: Confirmed Jun 01 04:40:31.034449 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Is-Admin-Project: True Jun 01 04:40:31.034449 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Id: default Jun 01 04:40:31.034449 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Name: Default Jun 01 04:40:31.034449 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Id: 6607408c2a46439d93026002d312b9de Jun 01 04:40:31.034449 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Name: tempest-VolumesActionsTest-769213739 Jun 01 04:40:31.034449 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Role: reader,member Jun 01 04:40:31.034449 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Roles: reader,member Jun 01 04:40:31.035996 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6607408c2a46439d93026002d312b9de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6607408c2a46439d93026002d312b9de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6607408c2a46439d93026002d312b9de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6607408c2a46439d93026002d312b9de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:40:31.035996 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant: tempest-VolumesActionsTest-769213739 Jun 01 04:40:31.035996 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Id: 6607408c2a46439d93026002d312b9de Jun 01 04:40:31.035996 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Name: tempest-VolumesActionsTest-769213739 Jun 01 04:40:31.035996 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User: tempest-VolumesActionsTest-769213739-project Jun 01 04:40:31.035996 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Id: default Jun 01 04:40:31.035996 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Name: Default Jun 01 04:40:31.035996 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Id: 80b97ad4fa674391a99cf97bc10da8bc Jun 01 04:40:31.035996 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Name: tempest-VolumesActionsTest-769213739-project Jun 01 04:40:31.035996 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: method: > Jun 01 04:40:31.035996 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: exception: Instance ebfba014-6e18-4a9b-a313-fb8d34eef6b0 could not be found. Jun 01 04:40:31.035996 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: action_args: {'id': 'ebfba014-6e18-4a9b-a313-fb8d34eef6b0'} Jun 01 04:40:31.039822 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:40:31.039822 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:40:31.039822 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:40:31.039822 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:40:31.039822 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:40:31.039822 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:40:31.039822 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:40:31.039822 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:40:31.039822 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:40:31.039822 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:40:31.039822 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebfba014-6e18-4a9b-a313-fb8d34eef6b0 could not be found. Jun 01 04:40:31.039822 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:40:31.039822 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:40:31.039822 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:40:31.039822 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:40:31.039822 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:40:31.039822 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:40:31.039822 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:40:31.039822 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:40:31.039822 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:40:31.041521 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:40:31.041521 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 01 04:40:31.041521 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 01 04:40:31.041521 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:40:31.041521 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:40:31.041521 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:40:31.041521 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:40:31.041521 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebfba014-6e18-4a9b-a313-fb8d34eef6b0 could not be found. Jun 01 04:40:31.041521 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:40:31.041521 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:40:31.041521 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:40:31.041521 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:40:31.041521 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:40:31.041521 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:40:31.041521 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:40:31.041521 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:40:31.041521 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebfba014-6e18-4a9b-a313-fb8d34eef6b0 could not be found. Jun 01 04:40:31.041521 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:40:31.043765 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d14eeba1-ad22-495a-875c-45b8056523cf tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] Returning 404 to user: Instance ebfba014-6e18-4a9b-a313-fb8d34eef6b0 could not be found. {{(pid=118516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:40:31.043765 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-d14eeba1-ad22-495a-875c-45b8056523cf tempest-VolumesActionsTest-769213739 tempest-VolumesActionsTest-769213739-project] 10.222.0.18 "GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0" status: 404 len: 111 microversion: 2.1 time: 0.031987 Jun 01 04:40:31.043765 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 550/1084] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:40:31 2022] GET /compute/v2.1/servers/ebfba014-6e18-4a9b-a313-fb8d34eef6b0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:40:31.513395 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-4e244cd5-e816-4ed3-9b15-df325f69b636 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] Calling method '.version_select at 0x7ff32ab45c10>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:40:31.611351 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-4e244cd5-e816-4ed3-9b15-df325f69b636 tempest-TestVolumeBootPattern-161219860 tempest-TestVolumeBootPattern-161219860-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1514032961" status: 202 len: 0 microversion: 2.1 time: 0.102818 Jun 01 04:40:31.611952 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 535/1085] 10.222.0.18 () {58 vars in 1262 bytes} [Wed Jun 1 04:40:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1514032961 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 01 04:41:04.971260 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-4881bfd0-deb0-4ee3-b1a2-beb1df66ee40 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:41:04.971848 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-4881bfd0-deb0-4ee3-b1a2-beb1df66ee40 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 51a21959-da2d-4c3c-8b95-02847c3cf58a] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:41:04.974098 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_api:SELECT=13 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:41:04.974744 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:41:04.979950 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4881bfd0-deb0-4ee3-b1a2-beb1df66ee40 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:04.980378 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4881bfd0-deb0-4ee3-b1a2-beb1df66ee40 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:04.981159 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4881bfd0-deb0-4ee3-b1a2-beb1df66ee40 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:04.982111 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4881bfd0-deb0-4ee3-b1a2-beb1df66ee40 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:05.005940 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-4881bfd0-deb0-4ee3-b1a2-beb1df66ee40 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a/ips" status: 200 len: 149 microversion: 2.1 time: 0.038821 Jun 01 04:41:05.006551 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 551/1086] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jun 1 04:41:04 2022] GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:41:07.859742 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=74 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:41:07.860420 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:41:07.864509 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-4486f119-e6d4-4bf5-ac6c-48af522e996e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d8306d5-f1a3-4fb0-a67f-e105ae732657"}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:41:07.865744 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-4486f119-e6d4-4bf5-ac6c-48af522e996e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 51a21959-da2d-4c3c-8b95-02847c3cf58a] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:41:07.872871 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4486f119-e6d4-4bf5-ac6c-48af522e996e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:07.875443 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4486f119-e6d4-4bf5-ac6c-48af522e996e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:07.875443 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4486f119-e6d4-4bf5-ac6c-48af522e996e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:07.875443 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4486f119-e6d4-4bf5-ac6c-48af522e996e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:08.625778 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-4486f119-e6d4-4bf5-ac6c-48af522e996e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "POST /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.767489 Jun 01 04:41:08.627269 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 536/1087] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 1 04:41:07 2022] POST /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a/os-volume_attachments => generated 194 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:41:17.196182 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-395e5089-2b6b-45ac-bff4-51cafc795c47 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Action: 'create', calling method: .version_select at 0x7ff3258cc940>, body: {"keypair": {"name": "tempest-keypair-1941730583", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAcmI8SG5rgtp/RZ4VBv8pCZZ/mLnXeU11PRf5z6Fm0pJPRJ50jByL6Vx9MUAdKvongVAEC4kRZY0hvIAwbhuAPHI+WpunMHgoMHxpvMwnOlvAjfkC+77BjDfEMO+GwEA=="}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:41:17.211950 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-395e5089-2b6b-45ac-bff4-51cafc795c47 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Getting quotas for project 756cb4ed8d2345dcaae27638b257a480. Resources: {'key_pairs'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:41:17.221458 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-395e5089-2b6b-45ac-bff4-51cafc795c47 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Getting quotas for user a17f39a1626d45299666f43be4ffc3ec and project 756cb4ed8d2345dcaae27638b257a480. Resources: {'key_pairs'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:41:17.296024 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-395e5089-2b6b-45ac-bff4-51cafc795c47 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.104106 Jun 01 04:41:17.296621 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 552/1088] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jun 1 04:41:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:41:19.475805 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_api:SELECT=2 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:41:19.476564 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:41:19.481409 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-ee60de59-cde6-424c-b9ae-5395c104ad10 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1102494336", "imageRef": "14321baa-3ac5-4c53-8054-4945abce5b2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8715975b-1e98-4a30-82e5-baf5c981e463"}], "security_groups": [{"name": "tempest-securitygroup--1525153072"}], "key_name": "tempest-keypair-1941730583", "user_data": "}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:41:19.589217 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.network.neutron [None req-ee60de59-cde6-424c-b9ae-5395c104ad10 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] validate_networks() for [('8715975b-1e98-4a30-82e5-baf5c981e463', None, None, None, None, None)] {{(pid=118517) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 01 04:41:20.051288 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-ee60de59-cde6-424c-b9ae-5395c104ad10 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Flavor limits 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 01 04:41:20.051742 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-ee60de59-cde6-424c-b9ae-5395c104ad10 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Image limits 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 01 04:41:20.052233 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-ee60de59-cde6-424c-b9ae-5395c104ad10 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Flavor pref 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 01 04:41:20.052640 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-ee60de59-cde6-424c-b9ae-5395c104ad10 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Image pref 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 01 04:41:20.053078 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-ee60de59-cde6-424c-b9ae-5395c104ad10 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 01 04:41:20.062434 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ee60de59-cde6-424c-b9ae-5395c104ad10 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:20.062874 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ee60de59-cde6-424c-b9ae-5395c104ad10 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:20.063695 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ee60de59-cde6-424c-b9ae-5395c104ad10 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:20.064125 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ee60de59-cde6-424c-b9ae-5395c104ad10 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:20.080165 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.quota [None req-ee60de59-cde6-424c-b9ae-5395c104ad10 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Getting quotas for project 756cb4ed8d2345dcaae27638b257a480. Resources: {'ram', 'instances', 'cores'} {{(pid=118517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:41:20.084034 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.quota [None req-ee60de59-cde6-424c-b9ae-5395c104ad10 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Getting quotas for user a17f39a1626d45299666f43be4ffc3ec and project 756cb4ed8d2345dcaae27638b257a480. Resources: {'ram', 'instances', 'cores'} {{(pid=118517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:41:20.094789 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-ee60de59-cde6-424c-b9ae-5395c104ad10 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Going to run 1 instances... {{(pid=118517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 01 04:41:20.097159 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-ee60de59-cde6-424c-b9ae-5395c104ad10 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 20a718f6-2774-49f5-833a-4aca569ae1b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14321baa-3ac5-4c53-8054-4945abce5b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 01 04:41:20.216415 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-ee60de59-cde6-424c-b9ae-5395c104ad10 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.742227 Jun 01 04:41:20.217184 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 537/1089] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 1 04:41:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 01 04:41:20.232419 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b69edec8-4149-4ab3-a7ed-102e3e2a493d tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:41:20.233236 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-b69edec8-4149-4ab3-a7ed-102e3e2a493d tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 20a718f6-2774-49f5-833a-4aca569ae1b7] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:41:20.298627 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b69edec8-4149-4ab3-a7ed-102e3e2a493d tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:41:20.306961 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-b69edec8-4149-4ab3-a7ed-102e3e2a493d tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7" status: 200 len: 1242 microversion: 2.1 time: 0.081355 Jun 01 04:41:20.307700 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 553/1090] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:41:20 2022] GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:41:21.326221 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-b35de15a-c09c-4b25-92ad-d90c96a3d842 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:41:21.326773 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-b35de15a-c09c-4b25-92ad-d90c96a3d842 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 20a718f6-2774-49f5-833a-4aca569ae1b7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:41:21.336112 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b35de15a-c09c-4b25-92ad-d90c96a3d842 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:21.336549 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b35de15a-c09c-4b25-92ad-d90c96a3d842 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:21.337322 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b35de15a-c09c-4b25-92ad-d90c96a3d842 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:21.337800 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b35de15a-c09c-4b25-92ad-d90c96a3d842 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:21.398542 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-b35de15a-c09c-4b25-92ad-d90c96a3d842 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:41:21.406398 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-b35de15a-c09c-4b25-92ad-d90c96a3d842 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7" status: 200 len: 1246 microversion: 2.1 time: 0.085230 Jun 01 04:41:21.406959 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 538/1091] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:41:21 2022] GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:41:22.423196 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-c572f4dc-1973-4c09-8bb7-d6adcbef8ba9 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:41:22.426613 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-c572f4dc-1973-4c09-8bb7-d6adcbef8ba9 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 20a718f6-2774-49f5-833a-4aca569ae1b7] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:41:22.435643 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c572f4dc-1973-4c09-8bb7-d6adcbef8ba9 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:22.436393 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c572f4dc-1973-4c09-8bb7-d6adcbef8ba9 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:22.437173 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c572f4dc-1973-4c09-8bb7-d6adcbef8ba9 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:22.437793 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c572f4dc-1973-4c09-8bb7-d6adcbef8ba9 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:22.521617 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-c572f4dc-1973-4c09-8bb7-d6adcbef8ba9 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:41:22.529645 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-c572f4dc-1973-4c09-8bb7-d6adcbef8ba9 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7" status: 200 len: 1302 microversion: 2.1 time: 0.110300 Jun 01 04:41:22.530220 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 554/1092] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:41:22 2022] GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7 => generated 1302 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:41:23.547108 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-1a75745b-8f7f-4c59-ae9f-598e6f746911 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:41:23.547884 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-1a75745b-8f7f-4c59-ae9f-598e6f746911 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 20a718f6-2774-49f5-833a-4aca569ae1b7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:41:23.554982 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1a75745b-8f7f-4c59-ae9f-598e6f746911 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:23.555479 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1a75745b-8f7f-4c59-ae9f-598e6f746911 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:23.556272 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1a75745b-8f7f-4c59-ae9f-598e6f746911 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:23.556712 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1a75745b-8f7f-4c59-ae9f-598e6f746911 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:23.697200 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-1a75745b-8f7f-4c59-ae9f-598e6f746911 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:41:23.706405 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-1a75745b-8f7f-4c59-ae9f-598e6f746911 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7" status: 200 len: 1368 microversion: 2.1 time: 0.163245 Jun 01 04:41:23.707584 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 539/1093] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:41:23 2022] GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:41:24.305792 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-020a1251-bcd0-4b81-9f53-e3568a6f5f2b req-3395ddb5-675d-444f-94b6-08e2a28a9e56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20a718f6-2774-49f5-833a-4aca569ae1b7", "tag": "e167d0ad-6f0f-470a-94b5-7928d778d368"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:41:24.315551 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-020a1251-bcd0-4b81-9f53-e3568a6f5f2b req-3395ddb5-675d-444f-94b6-08e2a28a9e56 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:24.316227 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-020a1251-bcd0-4b81-9f53-e3568a6f5f2b req-3395ddb5-675d-444f-94b6-08e2a28a9e56 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:24.329611 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-020a1251-bcd0-4b81-9f53-e3568a6f5f2b req-3395ddb5-675d-444f-94b6-08e2a28a9e56 service nova] Creating event network-changed:e167d0ad-6f0f-470a-94b5-7928d778d368 for instance 20a718f6-2774-49f5-833a-4aca569ae1b7 on hv-cinder-66710 Jun 01 04:41:24.334877 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-020a1251-bcd0-4b81-9f53-e3568a6f5f2b req-3395ddb5-675d-444f-94b6-08e2a28a9e56 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037954 Jun 01 04:41:24.335744 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 555/1094] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:41:24.727739 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-25a95ed6-220d-471f-a4b3-5dbddd13eab4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:41:24.728358 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-25a95ed6-220d-471f-a4b3-5dbddd13eab4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 20a718f6-2774-49f5-833a-4aca569ae1b7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:41:24.735889 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-25a95ed6-220d-471f-a4b3-5dbddd13eab4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:24.736361 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-25a95ed6-220d-471f-a4b3-5dbddd13eab4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:24.737234 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-25a95ed6-220d-471f-a4b3-5dbddd13eab4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:24.737744 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-25a95ed6-220d-471f-a4b3-5dbddd13eab4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:24.884097 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-25a95ed6-220d-471f-a4b3-5dbddd13eab4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:41:24.892336 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-25a95ed6-220d-471f-a4b3-5dbddd13eab4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7" status: 200 len: 1368 microversion: 2.1 time: 0.168430 Jun 01 04:41:24.892987 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 540/1095] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:41:24 2022] GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:41:25.910773 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-da5e3190-1d23-4256-9312-5b953e29363d tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:41:25.911408 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-da5e3190-1d23-4256-9312-5b953e29363d tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 20a718f6-2774-49f5-833a-4aca569ae1b7] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:41:25.917601 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-da5e3190-1d23-4256-9312-5b953e29363d tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:25.918049 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-da5e3190-1d23-4256-9312-5b953e29363d tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:25.918805 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-da5e3190-1d23-4256-9312-5b953e29363d tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:25.919267 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-da5e3190-1d23-4256-9312-5b953e29363d tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:26.057336 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-da5e3190-1d23-4256-9312-5b953e29363d tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:41:26.065676 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-da5e3190-1d23-4256-9312-5b953e29363d tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7" status: 200 len: 1368 microversion: 2.1 time: 0.159640 Jun 01 04:41:26.066314 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 556/1096] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:41:25 2022] GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:41:27.082469 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-9d2acb96-23f5-43eb-8d52-edbd15b60ccf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:41:27.083147 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-9d2acb96-23f5-43eb-8d52-edbd15b60ccf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 20a718f6-2774-49f5-833a-4aca569ae1b7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:41:27.090091 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9d2acb96-23f5-43eb-8d52-edbd15b60ccf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:27.090539 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9d2acb96-23f5-43eb-8d52-edbd15b60ccf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:27.091344 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9d2acb96-23f5-43eb-8d52-edbd15b60ccf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:27.092301 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9d2acb96-23f5-43eb-8d52-edbd15b60ccf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:27.224969 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-9d2acb96-23f5-43eb-8d52-edbd15b60ccf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:41:27.233208 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-9d2acb96-23f5-43eb-8d52-edbd15b60ccf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7" status: 200 len: 1368 microversion: 2.1 time: 0.154961 Jun 01 04:41:27.233762 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 541/1097] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:41:27 2022] GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:41:28.251635 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-2b25c958-0055-4764-8ecb-cfc4e6e16718 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:41:28.255747 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-2b25c958-0055-4764-8ecb-cfc4e6e16718 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 20a718f6-2774-49f5-833a-4aca569ae1b7] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:41:28.259040 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2b25c958-0055-4764-8ecb-cfc4e6e16718 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:28.259611 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2b25c958-0055-4764-8ecb-cfc4e6e16718 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:28.260460 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2b25c958-0055-4764-8ecb-cfc4e6e16718 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:28.260998 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-2b25c958-0055-4764-8ecb-cfc4e6e16718 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:28.405922 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-2b25c958-0055-4764-8ecb-cfc4e6e16718 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:41:28.413776 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-2b25c958-0055-4764-8ecb-cfc4e6e16718 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7" status: 200 len: 1368 microversion: 2.1 time: 0.167544 Jun 01 04:41:28.414340 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 557/1098] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:41:28 2022] GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:41:29.433933 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-6cdf67a0-5035-4671-80de-da37239027c4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:41:29.434846 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-6cdf67a0-5035-4671-80de-da37239027c4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 20a718f6-2774-49f5-833a-4aca569ae1b7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:41:29.441723 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6cdf67a0-5035-4671-80de-da37239027c4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:29.442164 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6cdf67a0-5035-4671-80de-da37239027c4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:29.442920 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6cdf67a0-5035-4671-80de-da37239027c4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:29.443508 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6cdf67a0-5035-4671-80de-da37239027c4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:29.597232 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-6cdf67a0-5035-4671-80de-da37239027c4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:41:29.608453 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-6cdf67a0-5035-4671-80de-da37239027c4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7" status: 200 len: 1368 microversion: 2.1 time: 0.178061 Jun 01 04:41:29.608957 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 542/1099] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:41:29 2022] GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7 => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:41:30.289612 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-9691dc7b-5a05-4c3c-a92e-4cc19643a458 req-099efa4b-2d17-4ffc-8420-22f4618e1a42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20a718f6-2774-49f5-833a-4aca569ae1b7", "name": "network-vif-plugged", "status": "completed", "tag": "e167d0ad-6f0f-470a-94b5-7928d778d368"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:41:30.299613 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-9691dc7b-5a05-4c3c-a92e-4cc19643a458 req-099efa4b-2d17-4ffc-8420-22f4618e1a42 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:30.300056 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-9691dc7b-5a05-4c3c-a92e-4cc19643a458 req-099efa4b-2d17-4ffc-8420-22f4618e1a42 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:30.309293 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell0:SELECT=6 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:41:30.315820 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-9691dc7b-5a05-4c3c-a92e-4cc19643a458 req-099efa4b-2d17-4ffc-8420-22f4618e1a42 service nova] Creating event network-vif-plugged:e167d0ad-6f0f-470a-94b5-7928d778d368 for instance 20a718f6-2774-49f5-833a-4aca569ae1b7 on hv-cinder-66710 Jun 01 04:41:30.317096 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-9691dc7b-5a05-4c3c-a92e-4cc19643a458 req-099efa4b-2d17-4ffc-8420-22f4618e1a42 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031932 Jun 01 04:41:30.317706 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 558/1100] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:41:30.626620 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-1a90d0f2-46da-4e8a-91e2-59ea0bad5af2 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:41:30.627249 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-1a90d0f2-46da-4e8a-91e2-59ea0bad5af2 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 20a718f6-2774-49f5-833a-4aca569ae1b7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:41:30.629278 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell0:SELECT=2 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:41:30.630024 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell0:SELECT=6 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:41:30.635540 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1a90d0f2-46da-4e8a-91e2-59ea0bad5af2 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:30.636440 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1a90d0f2-46da-4e8a-91e2-59ea0bad5af2 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:30.636961 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1a90d0f2-46da-4e8a-91e2-59ea0bad5af2 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:30.637471 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1a90d0f2-46da-4e8a-91e2-59ea0bad5af2 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:30.781072 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-1a90d0f2-46da-4e8a-91e2-59ea0bad5af2 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:41:30.789469 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-1a90d0f2-46da-4e8a-91e2-59ea0bad5af2 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7" status: 200 len: 1368 microversion: 2.1 time: 0.168232 Jun 01 04:41:30.790030 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 543/1101] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:41:30 2022] GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:41:31.806801 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-19d3653a-4bea-437b-95a6-bf081ba036c9 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:41:31.807574 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-19d3653a-4bea-437b-95a6-bf081ba036c9 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 20a718f6-2774-49f5-833a-4aca569ae1b7] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:41:31.814809 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-19d3653a-4bea-437b-95a6-bf081ba036c9 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:31.815268 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-19d3653a-4bea-437b-95a6-bf081ba036c9 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:31.816086 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-19d3653a-4bea-437b-95a6-bf081ba036c9 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:31.816549 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-19d3653a-4bea-437b-95a6-bf081ba036c9 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:31.947624 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-19d3653a-4bea-437b-95a6-bf081ba036c9 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:41:31.955783 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-19d3653a-4bea-437b-95a6-bf081ba036c9 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7" status: 200 len: 1368 microversion: 2.1 time: 0.153159 Jun 01 04:41:31.956348 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 559/1102] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:41:31 2022] GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:41:32.972633 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-34eb0b21-6f56-48a4-9372-35d3d625ebae tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:41:32.973243 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-34eb0b21-6f56-48a4-9372-35d3d625ebae tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 20a718f6-2774-49f5-833a-4aca569ae1b7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:41:32.980007 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-34eb0b21-6f56-48a4-9372-35d3d625ebae tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:32.980458 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-34eb0b21-6f56-48a4-9372-35d3d625ebae tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:32.981221 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-34eb0b21-6f56-48a4-9372-35d3d625ebae tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:32.981658 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-34eb0b21-6f56-48a4-9372-35d3d625ebae tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:33.112106 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-34eb0b21-6f56-48a4-9372-35d3d625ebae tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:41:33.117919 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-34eb0b21-6f56-48a4-9372-35d3d625ebae tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7" status: 200 len: 1557 microversion: 2.1 time: 0.149161 Jun 01 04:41:33.118487 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 544/1103] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:41:32 2022] GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:41:33.133908 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-9831c239-c6bd-4e3d-8102-cb4b04996910 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:41:33.134425 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-9831c239-c6bd-4e3d-8102-cb4b04996910 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 20a718f6-2774-49f5-833a-4aca569ae1b7] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:41:33.140892 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9831c239-c6bd-4e3d-8102-cb4b04996910 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:33.141335 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9831c239-c6bd-4e3d-8102-cb4b04996910 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:33.142104 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9831c239-c6bd-4e3d-8102-cb4b04996910 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:33.142544 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9831c239-c6bd-4e3d-8102-cb4b04996910 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:33.218956 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-9831c239-c6bd-4e3d-8102-cb4b04996910 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088823 Jun 01 04:41:33.219580 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 560/1104] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Jun 1 04:41:33 2022] GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:41:34.196046 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-b691e704-e9a5-4f0b-bf23-cd9e5f37dce8 req-45b6d6c0-1faf-4d13-b851-255b64b12c63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20a718f6-2774-49f5-833a-4aca569ae1b7", "tag": "e167d0ad-6f0f-470a-94b5-7928d778d368"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:41:34.205228 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-b691e704-e9a5-4f0b-bf23-cd9e5f37dce8 req-45b6d6c0-1faf-4d13-b851-255b64b12c63 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:41:34.205677 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-b691e704-e9a5-4f0b-bf23-cd9e5f37dce8 req-45b6d6c0-1faf-4d13-b851-255b64b12c63 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:41:34.217548 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-b691e704-e9a5-4f0b-bf23-cd9e5f37dce8 req-45b6d6c0-1faf-4d13-b851-255b64b12c63 service nova] Creating event network-changed:e167d0ad-6f0f-470a-94b5-7928d778d368 for instance 20a718f6-2774-49f5-833a-4aca569ae1b7 on hv-cinder-66710 Jun 01 04:41:34.222688 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-b691e704-e9a5-4f0b-bf23-cd9e5f37dce8 req-45b6d6c0-1faf-4d13-b851-255b64b12c63 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030609 Jun 01 04:41:34.223295 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 545/1105] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:42:33.084465 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 01 04:42:33.090913 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Wed Jun 1 04:42:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 01 04:42:38.984716 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:42:38.985554 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=36 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:42:38.989619 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-200c0e31-01c8-4cc0-a84e-9dba5c55b4b5 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:42:38.995210 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-200c0e31-01c8-4cc0-a84e-9dba5c55b4b5 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:38.996076 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-200c0e31-01c8-4cc0-a84e-9dba5c55b4b5 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:38.997134 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-200c0e31-01c8-4cc0-a84e-9dba5c55b4b5 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:38.997907 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-200c0e31-01c8-4cc0-a84e-9dba5c55b4b5 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:38.998340 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-200c0e31-01c8-4cc0-a84e-9dba5c55b4b5 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:39.023159 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.objects.instance [None req-200c0e31-01c8-4cc0-a84e-9dba5c55b4b5 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lazy-loading 'flavor' on Instance uuid ba731766-ac3f-4564-8c8a-09a909595ea3 {{(pid=118516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:42:39.331510 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-200c0e31-01c8-4cc0-a84e-9dba5c55b4b5 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "POST /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3/action" status: 202 len: 0 microversion: 2.1 time: 0.348305 Jun 01 04:42:39.332156 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 561/1106] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 1 04:42:38 2022] POST /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 01 04:42:39.338498 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:42:39.339269 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=46 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:42:39.343795 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-6657a766-557c-488d-aae7-5b7ac2499711 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:39.344497 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-6657a766-557c-488d-aae7-5b7ac2499711 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:39.351348 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6657a766-557c-488d-aae7-5b7ac2499711 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:39.351821 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6657a766-557c-488d-aae7-5b7ac2499711 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:39.352853 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6657a766-557c-488d-aae7-5b7ac2499711 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:39.353350 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6657a766-557c-488d-aae7-5b7ac2499711 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:39.676141 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-6657a766-557c-488d-aae7-5b7ac2499711 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:42:39.682660 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-6657a766-557c-488d-aae7-5b7ac2499711 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1567 microversion: 2.1 time: 0.346139 Jun 01 04:42:39.683397 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 546/1107] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:42:39 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1567 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:42:40.701255 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-51bef5e3-fe3b-4520-ac2c-8e560bed8539 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:40.701952 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-51bef5e3-fe3b-4520-ac2c-8e560bed8539 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:40.708344 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-51bef5e3-fe3b-4520-ac2c-8e560bed8539 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:40.708798 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-51bef5e3-fe3b-4520-ac2c-8e560bed8539 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:40.709562 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-51bef5e3-fe3b-4520-ac2c-8e560bed8539 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:40.710007 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-51bef5e3-fe3b-4520-ac2c-8e560bed8539 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:40.902165 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-51bef5e3-fe3b-4520-ac2c-8e560bed8539 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:42:40.910524 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-51bef5e3-fe3b-4520-ac2c-8e560bed8539 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1567 microversion: 2.1 time: 0.213999 Jun 01 04:42:40.911092 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 562/1108] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:42:40 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:42:41.928149 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-30dbb412-4d33-49e5-af0f-be617f03bf01 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:41.928682 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-30dbb412-4d33-49e5-af0f-be617f03bf01 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:41.935182 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-30dbb412-4d33-49e5-af0f-be617f03bf01 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:41.935656 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-30dbb412-4d33-49e5-af0f-be617f03bf01 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:41.936417 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-30dbb412-4d33-49e5-af0f-be617f03bf01 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:41.936848 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-30dbb412-4d33-49e5-af0f-be617f03bf01 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:42.069105 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-30dbb412-4d33-49e5-af0f-be617f03bf01 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:42:42.077355 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-30dbb412-4d33-49e5-af0f-be617f03bf01 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1567 microversion: 2.1 time: 0.153168 Jun 01 04:42:42.077917 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 547/1109] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:42:41 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:42:43.095212 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-86b5bd58-892a-49c6-bf60-95fe216d213e tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:43.095875 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-86b5bd58-892a-49c6-bf60-95fe216d213e tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:43.102938 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-86b5bd58-892a-49c6-bf60-95fe216d213e tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:43.103423 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-86b5bd58-892a-49c6-bf60-95fe216d213e tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:43.104202 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-86b5bd58-892a-49c6-bf60-95fe216d213e tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:43.104645 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-86b5bd58-892a-49c6-bf60-95fe216d213e tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:43.238332 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-86b5bd58-892a-49c6-bf60-95fe216d213e tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:42:43.245893 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-86b5bd58-892a-49c6-bf60-95fe216d213e tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1567 microversion: 2.1 time: 0.154655 Jun 01 04:42:43.247177 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 563/1110] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:42:43 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:42:44.264573 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-9a686e8a-9be2-4eb6-bc42-973e3a725236 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:44.265161 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-9a686e8a-9be2-4eb6-bc42-973e3a725236 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:44.271593 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9a686e8a-9be2-4eb6-bc42-973e3a725236 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:44.272043 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9a686e8a-9be2-4eb6-bc42-973e3a725236 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:44.272802 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9a686e8a-9be2-4eb6-bc42-973e3a725236 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:44.273403 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9a686e8a-9be2-4eb6-bc42-973e3a725236 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:44.405432 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-9a686e8a-9be2-4eb6-bc42-973e3a725236 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:42:44.412912 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-9a686e8a-9be2-4eb6-bc42-973e3a725236 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1567 microversion: 2.1 time: 0.152799 Jun 01 04:42:44.413489 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 548/1111] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:42:44 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:42:45.431388 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-1be2b9dc-50aa-4483-839d-e7b7d7ae6ee1 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:45.432040 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-1be2b9dc-50aa-4483-839d-e7b7d7ae6ee1 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:45.439077 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1be2b9dc-50aa-4483-839d-e7b7d7ae6ee1 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:45.439569 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1be2b9dc-50aa-4483-839d-e7b7d7ae6ee1 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:45.440344 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1be2b9dc-50aa-4483-839d-e7b7d7ae6ee1 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:45.440790 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1be2b9dc-50aa-4483-839d-e7b7d7ae6ee1 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:45.573501 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-1be2b9dc-50aa-4483-839d-e7b7d7ae6ee1 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:42:45.581576 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-1be2b9dc-50aa-4483-839d-e7b7d7ae6ee1 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1567 microversion: 2.1 time: 0.154096 Jun 01 04:42:45.582135 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 564/1112] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:42:45 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:42:46.600619 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-c15d7536-642e-4b88-9f2a-9b1395a21bd5 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:46.601208 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-c15d7536-642e-4b88-9f2a-9b1395a21bd5 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:46.608694 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c15d7536-642e-4b88-9f2a-9b1395a21bd5 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:46.609131 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c15d7536-642e-4b88-9f2a-9b1395a21bd5 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:46.609979 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c15d7536-642e-4b88-9f2a-9b1395a21bd5 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:46.610410 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c15d7536-642e-4b88-9f2a-9b1395a21bd5 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:46.746822 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-c15d7536-642e-4b88-9f2a-9b1395a21bd5 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:42:46.754532 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-c15d7536-642e-4b88-9f2a-9b1395a21bd5 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1567 microversion: 2.1 time: 0.158073 Jun 01 04:42:46.755107 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 549/1113] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:42:46 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:42:47.772061 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-8b8ec575-d18d-42ba-b659-e63e6957a5f3 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:47.772677 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-8b8ec575-d18d-42ba-b659-e63e6957a5f3 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:47.780107 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8b8ec575-d18d-42ba-b659-e63e6957a5f3 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:47.780569 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8b8ec575-d18d-42ba-b659-e63e6957a5f3 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:47.781347 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8b8ec575-d18d-42ba-b659-e63e6957a5f3 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:47.781789 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8b8ec575-d18d-42ba-b659-e63e6957a5f3 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:47.913628 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-8b8ec575-d18d-42ba-b659-e63e6957a5f3 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:42:47.921163 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-8b8ec575-d18d-42ba-b659-e63e6957a5f3 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1567 microversion: 2.1 time: 0.153123 Jun 01 04:42:47.921723 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 565/1114] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:42:47 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:42:48.938993 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a020b807-7988-4722-a582-60a50d7d795a tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:48.939631 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-a020b807-7988-4722-a582-60a50d7d795a tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:48.946189 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a020b807-7988-4722-a582-60a50d7d795a tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:48.946819 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a020b807-7988-4722-a582-60a50d7d795a tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:48.947605 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a020b807-7988-4722-a582-60a50d7d795a tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:48.948038 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a020b807-7988-4722-a582-60a50d7d795a tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:49.080269 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-a020b807-7988-4722-a582-60a50d7d795a tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:42:49.087822 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-a020b807-7988-4722-a582-60a50d7d795a tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1567 microversion: 2.1 time: 0.153570 Jun 01 04:42:49.088391 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 550/1115] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:42:48 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:42:49.572395 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-140a5baa-e716-408e-88f0-612a2ac9b70e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:49.582427 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-140a5baa-e716-408e-88f0-612a2ac9b70e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 20a718f6-2774-49f5-833a-4aca569ae1b7] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:49.582427 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-140a5baa-e716-408e-88f0-612a2ac9b70e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:49.582427 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-140a5baa-e716-408e-88f0-612a2ac9b70e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:49.582427 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-140a5baa-e716-408e-88f0-612a2ac9b70e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:49.582840 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-140a5baa-e716-408e-88f0-612a2ac9b70e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:49.604726 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-140a5baa-e716-408e-88f0-612a2ac9b70e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7/ips" status: 200 len: 148 microversion: 2.1 time: 0.036139 Jun 01 04:42:49.605309 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 566/1116] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jun 1 04:42:49 2022] GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7/ips => generated 148 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:42:49.615808 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-00540d4f-8297-4a02-ac98-4bb93e39fdf5 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d8306d5-f1a3-4fb0-a67f-e105ae732657"}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:42:49.616883 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-00540d4f-8297-4a02-ac98-4bb93e39fdf5 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 20a718f6-2774-49f5-833a-4aca569ae1b7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:49.623702 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-00540d4f-8297-4a02-ac98-4bb93e39fdf5 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:49.624156 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-00540d4f-8297-4a02-ac98-4bb93e39fdf5 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:49.624939 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-00540d4f-8297-4a02-ac98-4bb93e39fdf5 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:49.625613 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-00540d4f-8297-4a02-ac98-4bb93e39fdf5 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:49.705523 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.wsgi [None req-00540d4f-8297-4a02-ac98-4bb93e39fdf5 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] HTTP exception thrown: Invalid volume: volume 4d8306d5-f1a3-4fb0-a67f-e105ae732657 is already attached to instances: 51a21959-da2d-4c3c-8b95-02847c3cf58a Jun 01 04:42:49.707338 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-00540d4f-8297-4a02-ac98-4bb93e39fdf5 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Request method failure captured: Jun 01 04:42:49.707338 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: request: POST /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7/os-volume_attachments HTTP/1.1 Jun 01 04:42:49.707338 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept: application/json Jun 01 04:42:49.707338 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept-Encoding: identity Jun 01 04:42:49.707338 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Connection: close Jun 01 04:42:49.707338 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Length: 74 Jun 01 04:42:49.707338 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Type: application/json Jun 01 04:42:49.707338 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Host: 10.222.0.18 Jun 01 04:42:49.707338 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Openstack-System-Scope: None Jun 01 04:42:49.707338 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: User-Agent: python-urllib3/1.26.9 Jun 01 04:42:49.707338 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Auth-Token: gAAAAABilu106jtQ5FQFoI4uiqXA9VQRHJyx7H5fGGtMI-QLhZ9wzEW4QntKBbHMyg13vDMrRhGraMRm2tDoM-Qty4nj0NCDDE4r_xFFVOkMZvSyYWVAglaTnBtH6geTi9BY7b2EpB-efWXbewEEXtidDt5wGfiLJoigjqd8nO6N2RC-Av-UzW8 Jun 01 04:42:49.707338 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Id: None Jun 01 04:42:49.707338 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Name: None Jun 01 04:42:49.707338 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Identity-Status: Confirmed Jun 01 04:42:49.707338 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Is-Admin-Project: True Jun 01 04:42:49.707338 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Id: default Jun 01 04:42:49.707338 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Name: Default Jun 01 04:42:49.707338 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Id: 756cb4ed8d2345dcaae27638b257a480 Jun 01 04:42:49.707338 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Name: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:42:49.707338 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Role: reader,member Jun 01 04:42:49.707338 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Roles: reader,member Jun 01 04:42:49.709162 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:42:49.709162 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:42:49.709162 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Id: 756cb4ed8d2345dcaae27638b257a480 Jun 01 04:42:49.709162 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:42:49.709162 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User: tempest-AttachVolumeNegativeTest-373300167-project Jun 01 04:42:49.709162 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Id: default Jun 01 04:42:49.709162 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Name: Default Jun 01 04:42:49.709162 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Id: a17f39a1626d45299666f43be4ffc3ec Jun 01 04:42:49.709162 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Name: tempest-AttachVolumeNegativeTest-373300167-project Jun 01 04:42:49.709162 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Jun 01 04:42:49.709162 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {"volumeAttachment": {"volumeId": "4d8306d5-f1a3-4fb0-a67f-e105ae732657"}} Jun 01 04:42:49.709162 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: method: > Jun 01 04:42:49.710179 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: exception: Invalid volume: volume 4d8306d5-f1a3-4fb0-a67f-e105ae732657 is already attached to instances: 51a21959-da2d-4c3c-8b95-02847c3cf58a Jun 01 04:42:49.710179 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: action_args: {'server_id': '20a718f6-2774-49f5-833a-4aca569ae1b7', 'body': {'volumeAttachment': {'volumeId': '4d8306d5-f1a3-4fb0-a67f-e105ae732657'}}} Jun 01 04:42:49.710179 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:42:49.710179 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:42:49.710179 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 01 04:42:49.710179 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 01 04:42:49.710179 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 01 04:42:49.710179 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 01 04:42:49.710179 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 01 04:42:49.710179 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 01 04:42:49.710179 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 01 04:42:49.710179 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 01 04:42:49.710179 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 01 04:42:49.710179 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 01 04:42:49.710179 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4d8306d5-f1a3-4fb0-a67f-e105ae732657 is already attached to instances: 51a21959-da2d-4c3c-8b95-02847c3cf58a Jun 01 04:42:49.710179 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:42:49.710179 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:42:49.710179 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:42:49.710179 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:42:49.711905 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:42:49.711905 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:42:49.711905 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:42:49.711905 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:42:49.711905 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:42:49.711905 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:42:49.711905 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 01 04:42:49.711905 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 01 04:42:49.711905 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 01 04:42:49.711905 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 01 04:42:49.711905 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 01 04:42:49.711905 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 01 04:42:49.711905 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 01 04:42:49.711905 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 01 04:42:49.711905 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4d8306d5-f1a3-4fb0-a67f-e105ae732657 is already attached to instances: 51a21959-da2d-4c3c-8b95-02847c3cf58a Jun 01 04:42:49.711905 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:42:49.711905 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:42:49.711905 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:42:49.711905 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:42:49.711905 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:42:49.713569 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:42:49.713569 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:42:49.713569 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:42:49.713569 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4d8306d5-f1a3-4fb0-a67f-e105ae732657 is already attached to instances: 51a21959-da2d-4c3c-8b95-02847c3cf58a Jun 01 04:42:49.713569 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:42:49.713569 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-00540d4f-8297-4a02-ac98-4bb93e39fdf5 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Returning 400 to user: Invalid volume: volume 4d8306d5-f1a3-4fb0-a67f-e105ae732657 is already attached to instances: 51a21959-da2d-4c3c-8b95-02847c3cf58a {{(pid=118517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:42:49.713569 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-00540d4f-8297-4a02-ac98-4bb93e39fdf5 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "POST /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097140 Jun 01 04:42:49.713569 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 551/1117] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 1 04:42:49 2022] POST /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 01 04:42:49.717665 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-16b8a40f-dc8a-4bc4-81cb-fe81e8f6c57e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:49.718166 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-16b8a40f-dc8a-4bc4-81cb-fe81e8f6c57e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 20a718f6-2774-49f5-833a-4aca569ae1b7] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:49.724307 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-16b8a40f-dc8a-4bc4-81cb-fe81e8f6c57e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:49.724764 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-16b8a40f-dc8a-4bc4-81cb-fe81e8f6c57e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:49.725538 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-16b8a40f-dc8a-4bc4-81cb-fe81e8f6c57e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:49.725973 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-16b8a40f-dc8a-4bc4-81cb-fe81e8f6c57e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:49.755223 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-16b8a40f-dc8a-4bc4-81cb-fe81e8f6c57e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 20a718f6-2774-49f5-833a-4aca569ae1b7] Going to try to terminate instance {{(pid=118516) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 01 04:42:50.051333 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-16b8a40f-dc8a-4bc4-81cb-fe81e8f6c57e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "DELETE /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7" status: 204 len: 0 microversion: 2.1 time: 0.337293 Jun 01 04:42:50.051933 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 567/1118] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 1 04:42:49 2022] DELETE /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 01 04:42:50.060689 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a43292b4-f445-479c-a299-ab77e5efbfad tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:50.061315 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-a43292b4-f445-479c-a299-ab77e5efbfad tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 20a718f6-2774-49f5-833a-4aca569ae1b7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:50.071113 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a43292b4-f445-479c-a299-ab77e5efbfad tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:50.071649 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a43292b4-f445-479c-a299-ab77e5efbfad tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:50.072438 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a43292b4-f445-479c-a299-ab77e5efbfad tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:50.072882 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a43292b4-f445-479c-a299-ab77e5efbfad tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:50.115828 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-fbdc9f52-dd6a-4c81-99ab-fc47578a7d71 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:50.119216 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-fbdc9f52-dd6a-4c81-99ab-fc47578a7d71 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:50.136830 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fbdc9f52-dd6a-4c81-99ab-fc47578a7d71 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:50.137417 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fbdc9f52-dd6a-4c81-99ab-fc47578a7d71 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:50.138284 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fbdc9f52-dd6a-4c81-99ab-fc47578a7d71 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:50.138731 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-fbdc9f52-dd6a-4c81-99ab-fc47578a7d71 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:50.214581 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-a43292b4-f445-479c-a299-ab77e5efbfad tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:42:50.222714 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-a43292b4-f445-479c-a299-ab77e5efbfad tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7" status: 200 len: 1681 microversion: 2.1 time: 0.166447 Jun 01 04:42:50.223283 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 552/1119] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:42:50 2022] GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:42:50.272096 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-fbdc9f52-dd6a-4c81-99ab-fc47578a7d71 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:42:50.279779 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-fbdc9f52-dd6a-4c81-99ab-fc47578a7d71 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1567 microversion: 2.1 time: 0.178491 Jun 01 04:42:50.280343 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 568/1120] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:42:50 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:42:51.240710 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-98f8338e-58b4-4816-93dc-098876976ce4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:51.241306 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-98f8338e-58b4-4816-93dc-098876976ce4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 20a718f6-2774-49f5-833a-4aca569ae1b7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:51.247803 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-98f8338e-58b4-4816-93dc-098876976ce4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:51.248251 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-98f8338e-58b4-4816-93dc-098876976ce4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:51.249009 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-98f8338e-58b4-4816-93dc-098876976ce4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:51.249442 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-98f8338e-58b4-4816-93dc-098876976ce4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:51.298016 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-861b758d-46b3-4007-bd46-bfc6a16d3034 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:51.298623 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-861b758d-46b3-4007-bd46-bfc6a16d3034 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:51.305018 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-861b758d-46b3-4007-bd46-bfc6a16d3034 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:51.309222 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-861b758d-46b3-4007-bd46-bfc6a16d3034 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:51.309222 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-861b758d-46b3-4007-bd46-bfc6a16d3034 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:51.309222 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-861b758d-46b3-4007-bd46-bfc6a16d3034 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:51.384757 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-98f8338e-58b4-4816-93dc-098876976ce4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:42:51.392646 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-98f8338e-58b4-4816-93dc-098876976ce4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7" status: 200 len: 1681 microversion: 2.1 time: 0.155696 Jun 01 04:42:51.393224 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 553/1121] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:42:51 2022] GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:42:51.454367 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-861b758d-46b3-4007-bd46-bfc6a16d3034 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:42:51.462000 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-861b758d-46b3-4007-bd46-bfc6a16d3034 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1567 microversion: 2.1 time: 0.168514 Jun 01 04:42:51.462555 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 569/1122] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:42:51 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:42:52.409336 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-912ecd6a-e3b5-4aba-a063-4ec668f38473 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:52.409922 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-912ecd6a-e3b5-4aba-a063-4ec668f38473 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 20a718f6-2774-49f5-833a-4aca569ae1b7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:52.416556 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-912ecd6a-e3b5-4aba-a063-4ec668f38473 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:52.417004 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-912ecd6a-e3b5-4aba-a063-4ec668f38473 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:52.417765 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-912ecd6a-e3b5-4aba-a063-4ec668f38473 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:52.418197 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-912ecd6a-e3b5-4aba-a063-4ec668f38473 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:52.480225 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-d899cab5-947b-4f7d-9ea4-f341228109f5 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:52.480834 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-d899cab5-947b-4f7d-9ea4-f341228109f5 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:52.488028 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d899cab5-947b-4f7d-9ea4-f341228109f5 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:52.488487 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d899cab5-947b-4f7d-9ea4-f341228109f5 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:52.489269 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d899cab5-947b-4f7d-9ea4-f341228109f5 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:52.489712 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-d899cab5-947b-4f7d-9ea4-f341228109f5 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:52.550614 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-912ecd6a-e3b5-4aba-a063-4ec668f38473 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:42:52.558653 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-912ecd6a-e3b5-4aba-a063-4ec668f38473 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7" status: 200 len: 1681 microversion: 2.1 time: 0.153121 Jun 01 04:42:52.559229 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 554/1123] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:42:52 2022] GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:42:52.633004 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-d899cab5-947b-4f7d-9ea4-f341228109f5 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:42:52.641122 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-d899cab5-947b-4f7d-9ea4-f341228109f5 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1567 microversion: 2.1 time: 0.165122 Jun 01 04:42:52.641680 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 570/1124] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:42:52 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:42:53.578678 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-b88de178-3534-4ef3-88b8-1e99e60cfe1e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:53.579286 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-b88de178-3534-4ef3-88b8-1e99e60cfe1e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 20a718f6-2774-49f5-833a-4aca569ae1b7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:53.585615 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b88de178-3534-4ef3-88b8-1e99e60cfe1e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:53.586075 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b88de178-3534-4ef3-88b8-1e99e60cfe1e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:53.586852 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b88de178-3534-4ef3-88b8-1e99e60cfe1e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:53.587295 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-b88de178-3534-4ef3-88b8-1e99e60cfe1e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:53.658493 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-91b5c1eb-34b1-4dc3-97d8-fc492a30566e tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:53.659125 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-91b5c1eb-34b1-4dc3-97d8-fc492a30566e tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:53.665789 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-91b5c1eb-34b1-4dc3-97d8-fc492a30566e tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:53.666306 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-91b5c1eb-34b1-4dc3-97d8-fc492a30566e tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:53.667362 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-91b5c1eb-34b1-4dc3-97d8-fc492a30566e tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:53.667977 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-91b5c1eb-34b1-4dc3-97d8-fc492a30566e tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:53.746347 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-b88de178-3534-4ef3-88b8-1e99e60cfe1e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:42:53.755369 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-b88de178-3534-4ef3-88b8-1e99e60cfe1e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7" status: 200 len: 1681 microversion: 2.1 time: 0.181050 Jun 01 04:42:53.756224 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 555/1125] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:42:53 2022] GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7 => generated 1681 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:42:53.912743 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-91b5c1eb-34b1-4dc3-97d8-fc492a30566e tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:42:53.920601 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-91b5c1eb-34b1-4dc3-97d8-fc492a30566e tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1567 microversion: 2.1 time: 0.266055 Jun 01 04:42:53.921761 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 571/1126] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:42:53 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1567 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:42:54.085683 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-73701fdb-2365-4d50-abd6-d9e94a3e809c req-7eb80647-24f3-4407-8b72-3c4ac0d26a27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20a718f6-2774-49f5-833a-4aca569ae1b7", "name": "network-vif-deleted", "tag": "e167d0ad-6f0f-470a-94b5-7928d778d368"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:42:54.094602 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-73701fdb-2365-4d50-abd6-d9e94a3e809c req-7eb80647-24f3-4407-8b72-3c4ac0d26a27 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:54.099964 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-73701fdb-2365-4d50-abd6-d9e94a3e809c req-7eb80647-24f3-4407-8b72-3c4ac0d26a27 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:54.107383 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-73701fdb-2365-4d50-abd6-d9e94a3e809c req-7eb80647-24f3-4407-8b72-3c4ac0d26a27 service nova] Creating event network-vif-deleted:e167d0ad-6f0f-470a-94b5-7928d778d368 for instance 20a718f6-2774-49f5-833a-4aca569ae1b7 on hv-cinder-66710 Jun 01 04:42:54.113023 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-73701fdb-2365-4d50-abd6-d9e94a3e809c req-7eb80647-24f3-4407-8b72-3c4ac0d26a27 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030940 Jun 01 04:42:54.113906 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 556/1127] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:42:54.772960 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b285be5e-2b84-4732-89e6-2e86e3dbcd37 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:54.773580 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-b285be5e-2b84-4732-89e6-2e86e3dbcd37 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 20a718f6-2774-49f5-833a-4aca569ae1b7] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:54.781185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b285be5e-2b84-4732-89e6-2e86e3dbcd37 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:54.781636 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b285be5e-2b84-4732-89e6-2e86e3dbcd37 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:54.782416 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b285be5e-2b84-4732-89e6-2e86e3dbcd37 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:54.782852 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b285be5e-2b84-4732-89e6-2e86e3dbcd37 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:54.816419 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b285be5e-2b84-4732-89e6-2e86e3dbcd37 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:54.816881 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b285be5e-2b84-4732-89e6-2e86e3dbcd37 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:54.817341 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.objects.instance [None req-b285be5e-2b84-4732-89e6-2e86e3dbcd37 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lazy-loading 'fault' on Instance uuid 20a718f6-2774-49f5-833a-4aca569ae1b7 {{(pid=118516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:42:54.860666 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b285be5e-2b84-4732-89e6-2e86e3dbcd37 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:42:54.868151 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-b285be5e-2b84-4732-89e6-2e86e3dbcd37 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7" status: 200 len: 1332 microversion: 2.1 time: 0.099034 Jun 01 04:42:54.868705 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 572/1128] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:42:54 2022] GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7 => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:42:54.939733 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-891e8a9c-ee38-4563-8208-8c05fa852212 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:54.940458 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-891e8a9c-ee38-4563-8208-8c05fa852212 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:54.946910 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-891e8a9c-ee38-4563-8208-8c05fa852212 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:54.947459 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-891e8a9c-ee38-4563-8208-8c05fa852212 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:54.948314 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-891e8a9c-ee38-4563-8208-8c05fa852212 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:54.948756 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-891e8a9c-ee38-4563-8208-8c05fa852212 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:55.086304 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-891e8a9c-ee38-4563-8208-8c05fa852212 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:42:55.094901 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-891e8a9c-ee38-4563-8208-8c05fa852212 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1508 microversion: 2.1 time: 0.160579 Jun 01 04:42:55.095555 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 557/1129] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:42:54 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:42:55.118929 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-f40827d6-cbff-4455-90aa-c067dd2ae84d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:42:55.119581 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-f40827d6-cbff-4455-90aa-c067dd2ae84d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:55.126166 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f40827d6-cbff-4455-90aa-c067dd2ae84d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:55.126625 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f40827d6-cbff-4455-90aa-c067dd2ae84d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:55.127431 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f40827d6-cbff-4455-90aa-c067dd2ae84d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:55.127881 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f40827d6-cbff-4455-90aa-c067dd2ae84d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:55.163808 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:42:55.386889 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-f40827d6-cbff-4455-90aa-c067dd2ae84d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "POST /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3/action" status: 202 len: 0 microversion: 2.1 time: 0.272262 Jun 01 04:42:55.387528 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 573/1130] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jun 1 04:42:55 2022] POST /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 01 04:42:55.396438 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-7d19eac1-605d-4bdb-85d6-c9c6cdd46112 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:55.397149 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-7d19eac1-605d-4bdb-85d6-c9c6cdd46112 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:55.403455 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7d19eac1-605d-4bdb-85d6-c9c6cdd46112 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:55.405924 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7d19eac1-605d-4bdb-85d6-c9c6cdd46112 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:55.405924 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7d19eac1-605d-4bdb-85d6-c9c6cdd46112 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:55.405924 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7d19eac1-605d-4bdb-85d6-c9c6cdd46112 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:55.542817 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-7d19eac1-605d-4bdb-85d6-c9c6cdd46112 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:42:55.551490 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-7d19eac1-605d-4bdb-85d6-c9c6cdd46112 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1516 microversion: 2.1 time: 0.158873 Jun 01 04:42:55.552056 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 558/1131] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:42:55 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:42:55.886127 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-69045d83-29ff-4aa4-9873-fa4be65823ff tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:55.886744 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-69045d83-29ff-4aa4-9873-fa4be65823ff tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 20a718f6-2774-49f5-833a-4aca569ae1b7] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:55.893936 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-69045d83-29ff-4aa4-9873-fa4be65823ff tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:55.894744 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-69045d83-29ff-4aa4-9873-fa4be65823ff tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:55.895107 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-69045d83-29ff-4aa4-9873-fa4be65823ff tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:55.895573 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-69045d83-29ff-4aa4-9873-fa4be65823ff tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:55.910403 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.wsgi [None req-69045d83-29ff-4aa4-9873-fa4be65823ff tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] HTTP exception thrown: Instance 20a718f6-2774-49f5-833a-4aca569ae1b7 could not be found. Jun 01 04:42:55.912356 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-69045d83-29ff-4aa4-9873-fa4be65823ff tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Request method failure captured: Jun 01 04:42:55.912356 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: request: GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7 HTTP/1.1 Jun 01 04:42:55.912356 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept: application/json Jun 01 04:42:55.912356 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept-Encoding: identity Jun 01 04:42:55.912356 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Connection: close Jun 01 04:42:55.912356 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Length: 0 Jun 01 04:42:55.912356 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Type: application/json Jun 01 04:42:55.912356 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Host: 10.222.0.18 Jun 01 04:42:55.912356 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Openstack-System-Scope: None Jun 01 04:42:55.912356 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: User-Agent: python-urllib3/1.26.9 Jun 01 04:42:55.912356 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Auth-Token: gAAAAABilu106jtQ5FQFoI4uiqXA9VQRHJyx7H5fGGtMI-QLhZ9wzEW4QntKBbHMyg13vDMrRhGraMRm2tDoM-Qty4nj0NCDDE4r_xFFVOkMZvSyYWVAglaTnBtH6geTi9BY7b2EpB-efWXbewEEXtidDt5wGfiLJoigjqd8nO6N2RC-Av-UzW8 Jun 01 04:42:55.912356 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Id: None Jun 01 04:42:55.912356 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Name: None Jun 01 04:42:55.912356 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Identity-Status: Confirmed Jun 01 04:42:55.912356 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Is-Admin-Project: True Jun 01 04:42:55.912356 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Id: default Jun 01 04:42:55.912356 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Name: Default Jun 01 04:42:55.912356 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Id: 756cb4ed8d2345dcaae27638b257a480 Jun 01 04:42:55.912356 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Name: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:42:55.912356 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Role: reader,member Jun 01 04:42:55.912356 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Roles: reader,member Jun 01 04:42:55.914063 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:42:55.914063 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:42:55.914063 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Id: 756cb4ed8d2345dcaae27638b257a480 Jun 01 04:42:55.914063 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:42:55.914063 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User: tempest-AttachVolumeNegativeTest-373300167-project Jun 01 04:42:55.914063 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Id: default Jun 01 04:42:55.914063 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Name: Default Jun 01 04:42:55.914063 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Id: a17f39a1626d45299666f43be4ffc3ec Jun 01 04:42:55.914063 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Name: tempest-AttachVolumeNegativeTest-373300167-project Jun 01 04:42:55.914063 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: method: > Jun 01 04:42:55.914063 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: exception: Instance 20a718f6-2774-49f5-833a-4aca569ae1b7 could not be found. Jun 01 04:42:55.914063 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: action_args: {'id': '20a718f6-2774-49f5-833a-4aca569ae1b7'} Jun 01 04:42:55.918224 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:42:55.918224 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:42:55.918224 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:42:55.918224 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:42:55.918224 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:42:55.918224 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:42:55.918224 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:42:55.918224 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:42:55.918224 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:42:55.918224 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:42:55.918224 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20a718f6-2774-49f5-833a-4aca569ae1b7 could not be found. Jun 01 04:42:55.918224 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:42:55.918224 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:42:55.918224 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:42:55.918224 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:42:55.918224 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:42:55.918224 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:42:55.918224 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:42:55.918224 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:42:55.918224 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:42:55.920124 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:42:55.920124 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 01 04:42:55.920124 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 01 04:42:55.920124 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:42:55.920124 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:42:55.920124 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:42:55.920124 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:42:55.920124 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20a718f6-2774-49f5-833a-4aca569ae1b7 could not be found. Jun 01 04:42:55.920124 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:42:55.920124 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:42:55.920124 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:42:55.920124 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:42:55.920124 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:42:55.920124 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:42:55.920124 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:42:55.920124 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:42:55.920124 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20a718f6-2774-49f5-833a-4aca569ae1b7 could not be found. Jun 01 04:42:55.920124 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:42:55.922080 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-69045d83-29ff-4aa4-9873-fa4be65823ff tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Returning 404 to user: Instance 20a718f6-2774-49f5-833a-4aca569ae1b7 could not be found. {{(pid=118516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:42:55.922080 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-69045d83-29ff-4aa4-9873-fa4be65823ff tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7" status: 404 len: 111 microversion: 2.1 time: 0.032068 Jun 01 04:42:55.922080 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 574/1132] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:42:55 2022] GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:42:55.923032 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-4d83c54d-cdec-4e3e-87b9-85b520d73e0f tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '.version_select at 0x7ff325a09550>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:56.006496 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-4d83c54d-cdec-4e3e-87b9-85b520d73e0f tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1941730583" status: 202 len: 0 microversion: 2.1 time: 0.087668 Jun 01 04:42:56.007194 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 559/1133] 10.222.0.18 () {58 vars in 1220 bytes} [Wed Jun 1 04:42:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1941730583 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 01 04:42:56.569843 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-4bb99796-0651-4899-9794-60f3a5b71691 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:56.570568 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-4bb99796-0651-4899-9794-60f3a5b71691 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:56.578496 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4bb99796-0651-4899-9794-60f3a5b71691 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:56.579077 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4bb99796-0651-4899-9794-60f3a5b71691 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:56.581415 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4bb99796-0651-4899-9794-60f3a5b71691 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:56.582473 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4bb99796-0651-4899-9794-60f3a5b71691 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:56.616052 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-a72c70bb-8ab6-4748-9772-4da21236e052 req-e4f1764c-d635-4875-ae4d-1bbc69280f24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba731766-ac3f-4564-8c8a-09a909595ea3", "name": "network-vif-unplugged", "status": "completed", "tag": "642b3902-1011-48e3-b526-4497466efc94"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:42:56.643849 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-a72c70bb-8ab6-4748-9772-4da21236e052 req-e4f1764c-d635-4875-ae4d-1bbc69280f24 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:56.653711 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-a72c70bb-8ab6-4748-9772-4da21236e052 req-e4f1764c-d635-4875-ae4d-1bbc69280f24 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:56.665874 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.compute.server_external_events [req-a72c70bb-8ab6-4748-9772-4da21236e052 req-e4f1764c-d635-4875-ae4d-1bbc69280f24 service nova] Unable to find a host for instance ba731766-ac3f-4564-8c8a-09a909595ea3. Dropping event network-vif-unplugged {{(pid=118517) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 01 04:42:56.666952 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-a72c70bb-8ab6-4748-9772-4da21236e052 req-e4f1764c-d635-4875-ae4d-1bbc69280f24 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.054853 Jun 01 04:42:56.668137 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 560/1134] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 56 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 01 04:42:56.834270 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-4bb99796-0651-4899-9794-60f3a5b71691 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:42:56.842071 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-4bb99796-0651-4899-9794-60f3a5b71691 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1518 microversion: 2.1 time: 0.276915 Jun 01 04:42:56.842848 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 575/1135] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:42:56 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1518 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:42:56.895411 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-7e3529c0-9562-4f33-adf2-7516abda4bff tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:56.895910 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-7e3529c0-9562-4f33-adf2-7516abda4bff tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 51a21959-da2d-4c3c-8b95-02847c3cf58a] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:56.901898 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7e3529c0-9562-4f33-adf2-7516abda4bff tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:56.902342 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7e3529c0-9562-4f33-adf2-7516abda4bff tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:56.903138 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7e3529c0-9562-4f33-adf2-7516abda4bff tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:56.903597 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-7e3529c0-9562-4f33-adf2-7516abda4bff tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:56.984994 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.objects.instance [None req-7e3529c0-9562-4f33-adf2-7516abda4bff tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lazy-loading 'services' on Instance uuid 51a21959-da2d-4c3c-8b95-02847c3cf58a {{(pid=118517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:42:57.210911 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-7e3529c0-9562-4f33-adf2-7516abda4bff tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "DELETE /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a/os-volume_attachments/4d8306d5-f1a3-4fb0-a67f-e105ae732657" status: 202 len: 0 microversion: 2.1 time: 0.319298 Jun 01 04:42:57.211624 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 561/1136] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 1 04:42:56 2022] DELETE /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a/os-volume_attachments/4d8306d5-f1a3-4fb0-a67f-e105ae732657 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 01 04:42:57.220099 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-89cc8828-f5d4-45fc-993b-3fb8dd69ed65 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:57.220965 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-89cc8828-f5d4-45fc-993b-3fb8dd69ed65 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 51a21959-da2d-4c3c-8b95-02847c3cf58a] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:57.227956 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-89cc8828-f5d4-45fc-993b-3fb8dd69ed65 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:57.228408 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-89cc8828-f5d4-45fc-993b-3fb8dd69ed65 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:57.229185 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-89cc8828-f5d4-45fc-993b-3fb8dd69ed65 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:57.229628 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-89cc8828-f5d4-45fc-993b-3fb8dd69ed65 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:57.259296 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-89cc8828-f5d4-45fc-993b-3fb8dd69ed65 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043212 Jun 01 04:42:57.259875 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 576/1137] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 1 04:42:57 2022] GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:42:57.871874 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-65c3992f-e6e3-4b22-b27a-8cd0b8ac7c76 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:57.872595 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-65c3992f-e6e3-4b22-b27a-8cd0b8ac7c76 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:57.878776 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-65c3992f-e6e3-4b22-b27a-8cd0b8ac7c76 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:57.879231 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-65c3992f-e6e3-4b22-b27a-8cd0b8ac7c76 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:57.880023 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-65c3992f-e6e3-4b22-b27a-8cd0b8ac7c76 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:57.880465 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-65c3992f-e6e3-4b22-b27a-8cd0b8ac7c76 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:58.013208 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-65c3992f-e6e3-4b22-b27a-8cd0b8ac7c76 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:42:58.020763 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-65c3992f-e6e3-4b22-b27a-8cd0b8ac7c76 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1518 microversion: 2.1 time: 0.153183 Jun 01 04:42:58.021349 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 562/1138] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:42:57 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:42:58.271051 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-77ce3195-8e75-4d09-936f-7e0dc075f8dc tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:58.272006 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-77ce3195-8e75-4d09-936f-7e0dc075f8dc tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 51a21959-da2d-4c3c-8b95-02847c3cf58a] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:58.278820 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-77ce3195-8e75-4d09-936f-7e0dc075f8dc tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:58.279272 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-77ce3195-8e75-4d09-936f-7e0dc075f8dc tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:58.280070 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-77ce3195-8e75-4d09-936f-7e0dc075f8dc tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:58.280575 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-77ce3195-8e75-4d09-936f-7e0dc075f8dc tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:58.310366 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-77ce3195-8e75-4d09-936f-7e0dc075f8dc tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043244 Jun 01 04:42:58.310926 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 577/1139] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 1 04:42:58 2022] GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:42:59.037996 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-c0ab82b0-2db8-4a59-aec5-e14016d8e659 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:59.038746 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-c0ab82b0-2db8-4a59-aec5-e14016d8e659 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:59.045423 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c0ab82b0-2db8-4a59-aec5-e14016d8e659 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:59.046376 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c0ab82b0-2db8-4a59-aec5-e14016d8e659 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:59.047158 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c0ab82b0-2db8-4a59-aec5-e14016d8e659 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:59.047619 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-c0ab82b0-2db8-4a59-aec5-e14016d8e659 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:59.179090 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-c0ab82b0-2db8-4a59-aec5-e14016d8e659 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:42:59.187374 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-c0ab82b0-2db8-4a59-aec5-e14016d8e659 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1574 microversion: 2.1 time: 0.152622 Jun 01 04:42:59.188042 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 563/1140] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:42:59 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:42:59.322089 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-7cbaaeb8-8ff9-4998-81e3-cc476ce09611 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:59.323014 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-7cbaaeb8-8ff9-4998-81e3-cc476ce09611 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 51a21959-da2d-4c3c-8b95-02847c3cf58a] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:59.330174 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7cbaaeb8-8ff9-4998-81e3-cc476ce09611 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:59.330623 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7cbaaeb8-8ff9-4998-81e3-cc476ce09611 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:59.331533 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7cbaaeb8-8ff9-4998-81e3-cc476ce09611 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:59.331968 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7cbaaeb8-8ff9-4998-81e3-cc476ce09611 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:59.362809 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-7cbaaeb8-8ff9-4998-81e3-cc476ce09611 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044576 Jun 01 04:42:59.363413 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 578/1141] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 1 04:42:59 2022] GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 01 04:42:59.419216 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-e6c60f90-adb1-41fc-a097-6c02c555cd24 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:59.419699 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-e6c60f90-adb1-41fc-a097-6c02c555cd24 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 51a21959-da2d-4c3c-8b95-02847c3cf58a] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:59.428581 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e6c60f90-adb1-41fc-a097-6c02c555cd24 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:59.429028 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e6c60f90-adb1-41fc-a097-6c02c555cd24 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:59.429824 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e6c60f90-adb1-41fc-a097-6c02c555cd24 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:59.430253 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e6c60f90-adb1-41fc-a097-6c02c555cd24 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:59.434424 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:42:59.454841 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-e6c60f90-adb1-41fc-a097-6c02c555cd24 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 51a21959-da2d-4c3c-8b95-02847c3cf58a] Going to try to terminate instance {{(pid=118517) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 01 04:42:59.755019 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-e6c60f90-adb1-41fc-a097-6c02c555cd24 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "DELETE /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a" status: 204 len: 0 microversion: 2.1 time: 0.339433 Jun 01 04:42:59.755631 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 564/1142] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 1 04:42:59 2022] DELETE /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 01 04:42:59.763540 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-1b6af99e-59d1-447a-8c24-bf0c7a153b21 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:42:59.764146 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-1b6af99e-59d1-447a-8c24-bf0c7a153b21 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 51a21959-da2d-4c3c-8b95-02847c3cf58a] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:42:59.770751 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1b6af99e-59d1-447a-8c24-bf0c7a153b21 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:59.771199 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1b6af99e-59d1-447a-8c24-bf0c7a153b21 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:59.771991 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1b6af99e-59d1-447a-8c24-bf0c7a153b21 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:42:59.772423 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1b6af99e-59d1-447a-8c24-bf0c7a153b21 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:42:59.899576 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-1b6af99e-59d1-447a-8c24-bf0c7a153b21 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:42:59.908090 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-1b6af99e-59d1-447a-8c24-bf0c7a153b21 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a" status: 200 len: 1680 microversion: 2.1 time: 0.148294 Jun 01 04:42:59.909248 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 579/1143] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:42:59 2022] GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:43:00.205877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-48e36c43-c88d-4c53-ab7e-9367b4b28e4a tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:43:00.206575 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-48e36c43-c88d-4c53-ab7e-9367b4b28e4a tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:43:00.213491 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-48e36c43-c88d-4c53-ab7e-9367b4b28e4a tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:00.214600 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-48e36c43-c88d-4c53-ab7e-9367b4b28e4a tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:00.214769 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-48e36c43-c88d-4c53-ab7e-9367b4b28e4a tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:00.215129 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-48e36c43-c88d-4c53-ab7e-9367b4b28e4a tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:00.354449 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-48e36c43-c88d-4c53-ab7e-9367b4b28e4a tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:43:00.363093 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-48e36c43-c88d-4c53-ab7e-9367b4b28e4a tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1574 microversion: 2.1 time: 0.161947 Jun 01 04:43:00.363974 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 565/1144] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:43:00 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:43:00.925217 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-540ff2ea-55a8-4140-9451-114157627a82 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:43:00.925739 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-540ff2ea-55a8-4140-9451-114157627a82 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 51a21959-da2d-4c3c-8b95-02847c3cf58a] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:43:00.932261 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-540ff2ea-55a8-4140-9451-114157627a82 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:00.932712 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-540ff2ea-55a8-4140-9451-114157627a82 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:00.933470 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-540ff2ea-55a8-4140-9451-114157627a82 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:00.933914 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-540ff2ea-55a8-4140-9451-114157627a82 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:01.065462 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-540ff2ea-55a8-4140-9451-114157627a82 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:43:01.073123 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-540ff2ea-55a8-4140-9451-114157627a82 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a" status: 200 len: 1680 microversion: 2.1 time: 0.151834 Jun 01 04:43:01.073679 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 580/1145] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:43:00 2022] GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:43:01.380277 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-e2a0775d-7aea-4aa9-951f-dc5fae500e4c tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:43:01.380888 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-e2a0775d-7aea-4aa9-951f-dc5fae500e4c tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:43:01.387320 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e2a0775d-7aea-4aa9-951f-dc5fae500e4c tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:01.387782 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e2a0775d-7aea-4aa9-951f-dc5fae500e4c tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:01.388547 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e2a0775d-7aea-4aa9-951f-dc5fae500e4c tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:01.388985 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e2a0775d-7aea-4aa9-951f-dc5fae500e4c tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:01.523328 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-e2a0775d-7aea-4aa9-951f-dc5fae500e4c tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:43:01.530823 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-e2a0775d-7aea-4aa9-951f-dc5fae500e4c tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1574 microversion: 2.1 time: 0.154456 Jun 01 04:43:01.531405 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 566/1146] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:43:01 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:43:02.091129 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-aad8d46d-46a0-4c40-83ae-cc0e0906813e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:43:02.091765 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-aad8d46d-46a0-4c40-83ae-cc0e0906813e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 51a21959-da2d-4c3c-8b95-02847c3cf58a] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:43:02.098560 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-aad8d46d-46a0-4c40-83ae-cc0e0906813e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:02.099011 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-aad8d46d-46a0-4c40-83ae-cc0e0906813e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:02.099816 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-aad8d46d-46a0-4c40-83ae-cc0e0906813e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:02.100258 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-aad8d46d-46a0-4c40-83ae-cc0e0906813e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:02.242725 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-aad8d46d-46a0-4c40-83ae-cc0e0906813e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:43:02.251121 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-aad8d46d-46a0-4c40-83ae-cc0e0906813e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a" status: 200 len: 1680 microversion: 2.1 time: 0.164516 Jun 01 04:43:02.251739 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 581/1147] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:43:02 2022] GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:43:02.548502 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-08ad307b-ffb4-41e6-9e19-93cecd8f0e5a tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:43:02.549117 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-08ad307b-ffb4-41e6-9e19-93cecd8f0e5a tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:43:02.555542 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-08ad307b-ffb4-41e6-9e19-93cecd8f0e5a tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:02.555998 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-08ad307b-ffb4-41e6-9e19-93cecd8f0e5a tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:02.556772 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-08ad307b-ffb4-41e6-9e19-93cecd8f0e5a tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:02.557216 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-08ad307b-ffb4-41e6-9e19-93cecd8f0e5a tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:02.691984 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-08ad307b-ffb4-41e6-9e19-93cecd8f0e5a tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:43:02.699727 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-08ad307b-ffb4-41e6-9e19-93cecd8f0e5a tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1574 microversion: 2.1 time: 0.155697 Jun 01 04:43:02.700293 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 567/1148] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:43:02 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:43:03.270476 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-cf8281cd-a6a3-4eac-b96d-6b5c36f16fbf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:43:03.271259 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-cf8281cd-a6a3-4eac-b96d-6b5c36f16fbf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 51a21959-da2d-4c3c-8b95-02847c3cf58a] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:43:03.277362 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cf8281cd-a6a3-4eac-b96d-6b5c36f16fbf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:03.278318 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cf8281cd-a6a3-4eac-b96d-6b5c36f16fbf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:03.279393 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cf8281cd-a6a3-4eac-b96d-6b5c36f16fbf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:03.280621 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-cf8281cd-a6a3-4eac-b96d-6b5c36f16fbf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:03.287169 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-b691a70b-2061-4325-b4a8-d80144454665 req-47ee1fec-465b-4545-8927-c618f6e1bac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51a21959-da2d-4c3c-8b95-02847c3cf58a", "name": "network-vif-deleted", "tag": "0a53c886-36f8-4ef1-a236-0be39e1c7bc4"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:43:03.299005 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-b691a70b-2061-4325-b4a8-d80144454665 req-47ee1fec-465b-4545-8927-c618f6e1bac7 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:03.299458 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-b691a70b-2061-4325-b4a8-d80144454665 req-47ee1fec-465b-4545-8927-c618f6e1bac7 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:03.317083 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-b691a70b-2061-4325-b4a8-d80144454665 req-47ee1fec-465b-4545-8927-c618f6e1bac7 service nova] Creating event network-vif-deleted:0a53c886-36f8-4ef1-a236-0be39e1c7bc4 for instance 51a21959-da2d-4c3c-8b95-02847c3cf58a on hv-cinder-66710 Jun 01 04:43:03.323521 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-b691a70b-2061-4325-b4a8-d80144454665 req-47ee1fec-465b-4545-8927-c618f6e1bac7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039626 Jun 01 04:43:03.327474 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 568/1149] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:43:03.369150 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-cf8281cd-a6a3-4eac-b96d-6b5c36f16fbf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:43:03.377834 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-cf8281cd-a6a3-4eac-b96d-6b5c36f16fbf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a" status: 200 len: 1613 microversion: 2.1 time: 0.113217 Jun 01 04:43:03.378757 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 582/1150] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:43:03 2022] GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a => generated 1613 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:43:03.719212 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-6de9803d-b12c-4267-8cfb-283d15bbec32 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:43:03.719948 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-6de9803d-b12c-4267-8cfb-283d15bbec32 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:43:03.730588 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6de9803d-b12c-4267-8cfb-283d15bbec32 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:03.731475 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6de9803d-b12c-4267-8cfb-283d15bbec32 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:03.732265 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6de9803d-b12c-4267-8cfb-283d15bbec32 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:03.732698 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6de9803d-b12c-4267-8cfb-283d15bbec32 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:03.872876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-6de9803d-b12c-4267-8cfb-283d15bbec32 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:43:03.880490 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-6de9803d-b12c-4267-8cfb-283d15bbec32 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1574 microversion: 2.1 time: 0.166321 Jun 01 04:43:03.881199 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 569/1151] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:43:03 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:43:04.395061 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b6edcc5d-6d96-431b-99a4-f297f94b77d9 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:43:04.395704 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-b6edcc5d-6d96-431b-99a4-f297f94b77d9 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 51a21959-da2d-4c3c-8b95-02847c3cf58a] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:43:04.402250 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b6edcc5d-6d96-431b-99a4-f297f94b77d9 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:04.402703 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b6edcc5d-6d96-431b-99a4-f297f94b77d9 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:04.403556 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b6edcc5d-6d96-431b-99a4-f297f94b77d9 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:04.406639 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b6edcc5d-6d96-431b-99a4-f297f94b77d9 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:04.418419 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.wsgi [None req-b6edcc5d-6d96-431b-99a4-f297f94b77d9 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] HTTP exception thrown: Instance 51a21959-da2d-4c3c-8b95-02847c3cf58a could not be found. Jun 01 04:43:04.420046 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b6edcc5d-6d96-431b-99a4-f297f94b77d9 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Request method failure captured: Jun 01 04:43:04.420046 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: request: GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a HTTP/1.1 Jun 01 04:43:04.420046 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept: application/json Jun 01 04:43:04.420046 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept-Encoding: identity Jun 01 04:43:04.420046 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Connection: close Jun 01 04:43:04.420046 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Length: 0 Jun 01 04:43:04.420046 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Type: application/json Jun 01 04:43:04.420046 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Host: 10.222.0.18 Jun 01 04:43:04.420046 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Openstack-System-Scope: None Jun 01 04:43:04.420046 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: User-Agent: python-urllib3/1.26.9 Jun 01 04:43:04.420046 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Auth-Token: gAAAAABilu106jtQ5FQFoI4uiqXA9VQRHJyx7H5fGGtMI-QLhZ9wzEW4QntKBbHMyg13vDMrRhGraMRm2tDoM-Qty4nj0NCDDE4r_xFFVOkMZvSyYWVAglaTnBtH6geTi9BY7b2EpB-efWXbewEEXtidDt5wGfiLJoigjqd8nO6N2RC-Av-UzW8 Jun 01 04:43:04.420046 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Id: None Jun 01 04:43:04.420046 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Name: None Jun 01 04:43:04.420046 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Identity-Status: Confirmed Jun 01 04:43:04.420046 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Is-Admin-Project: True Jun 01 04:43:04.420046 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Id: default Jun 01 04:43:04.420046 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Name: Default Jun 01 04:43:04.420046 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Id: 756cb4ed8d2345dcaae27638b257a480 Jun 01 04:43:04.420046 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Name: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:43:04.420046 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Role: reader,member Jun 01 04:43:04.420046 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Roles: reader,member Jun 01 04:43:04.421907 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:43:04.421907 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:43:04.421907 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Id: 756cb4ed8d2345dcaae27638b257a480 Jun 01 04:43:04.421907 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:43:04.421907 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User: tempest-AttachVolumeNegativeTest-373300167-project Jun 01 04:43:04.421907 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Id: default Jun 01 04:43:04.421907 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Name: Default Jun 01 04:43:04.421907 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Id: a17f39a1626d45299666f43be4ffc3ec Jun 01 04:43:04.421907 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Name: tempest-AttachVolumeNegativeTest-373300167-project Jun 01 04:43:04.421907 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: method: > Jun 01 04:43:04.421907 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: exception: Instance 51a21959-da2d-4c3c-8b95-02847c3cf58a could not be found. Jun 01 04:43:04.421907 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: action_args: {'id': '51a21959-da2d-4c3c-8b95-02847c3cf58a'} Jun 01 04:43:04.422694 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:43:04.422694 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:43:04.422694 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:43:04.422694 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:43:04.422694 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:43:04.422694 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:43:04.422694 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:43:04.422694 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:43:04.422694 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:43:04.422694 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:43:04.422694 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51a21959-da2d-4c3c-8b95-02847c3cf58a could not be found. Jun 01 04:43:04.422694 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:43:04.422694 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:43:04.422694 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:43:04.422694 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:43:04.422694 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:43:04.422694 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:43:04.422694 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:43:04.422694 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:43:04.422694 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:43:04.423993 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:43:04.423993 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 01 04:43:04.423993 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 01 04:43:04.423993 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:43:04.423993 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:43:04.423993 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:43:04.423993 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:43:04.423993 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51a21959-da2d-4c3c-8b95-02847c3cf58a could not be found. Jun 01 04:43:04.423993 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:43:04.423993 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:43:04.423993 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:43:04.423993 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:43:04.423993 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:43:04.423993 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:43:04.423993 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:43:04.423993 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:43:04.423993 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51a21959-da2d-4c3c-8b95-02847c3cf58a could not be found. Jun 01 04:43:04.423993 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:43:04.425147 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b6edcc5d-6d96-431b-99a4-f297f94b77d9 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Returning 404 to user: Instance 51a21959-da2d-4c3c-8b95-02847c3cf58a could not be found. {{(pid=118516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:43:04.425147 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-b6edcc5d-6d96-431b-99a4-f297f94b77d9 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a" status: 404 len: 111 microversion: 2.1 time: 0.030893 Jun 01 04:43:04.425147 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 583/1152] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:43:04 2022] GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:43:04.431440 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-f2dfe409-14b6-4351-99d0-ede8dc5ec4df tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '.version_select at 0x7ff32ab52dc0>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:43:04.510045 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-f2dfe409-14b6-4351-99d0-ede8dc5ec4df tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1397796552" status: 202 len: 0 microversion: 2.1 time: 0.082506 Jun 01 04:43:04.510632 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 570/1153] 10.222.0.18 () {58 vars in 1220 bytes} [Wed Jun 1 04:43:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1397796552 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 01 04:43:04.897613 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-8e01607d-fb43-4f5f-8a10-8e09f1c3b2ac tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:43:04.898231 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-8e01607d-fb43-4f5f-8a10-8e09f1c3b2ac tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:43:04.904332 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8e01607d-fb43-4f5f-8a10-8e09f1c3b2ac tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:04.904796 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8e01607d-fb43-4f5f-8a10-8e09f1c3b2ac tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:04.905623 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8e01607d-fb43-4f5f-8a10-8e09f1c3b2ac tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:04.906073 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8e01607d-fb43-4f5f-8a10-8e09f1c3b2ac tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:05.045313 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-8e01607d-fb43-4f5f-8a10-8e09f1c3b2ac tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:43:05.053741 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-8e01607d-fb43-4f5f-8a10-8e09f1c3b2ac tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1574 microversion: 2.1 time: 0.160216 Jun 01 04:43:05.054301 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 584/1154] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:43:04 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:43:05.216396 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-2e29f0ce-c3eb-4341-a5e5-d415abc6e5a1 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Action: 'create', calling method: .version_select at 0x7ff32568b310>, body: {"keypair": {"name": "tempest-keypair-1587629131", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCiQm08Sd22WbMYJMYRIB2SYWefo34MxKRt7IeT3dZR1Qp31Ox6VSpYF2j22SFLP/bxhl1woQyGEfk+I3H6+u+vq/AQve8toLF5hDpikxwcFMcnML78B4nsYXZywJ92FtA=="}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:43:05.230449 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.quota [None req-2e29f0ce-c3eb-4341-a5e5-d415abc6e5a1 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Getting quotas for project 756cb4ed8d2345dcaae27638b257a480. Resources: {'key_pairs'} {{(pid=118517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:43:05.234676 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.quota [None req-2e29f0ce-c3eb-4341-a5e5-d415abc6e5a1 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Getting quotas for user a17f39a1626d45299666f43be4ffc3ec and project 756cb4ed8d2345dcaae27638b257a480. Resources: {'key_pairs'} {{(pid=118517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:43:05.310128 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-2e29f0ce-c3eb-4341-a5e5-d415abc6e5a1 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.098039 Jun 01 04:43:05.310739 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 571/1155] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jun 1 04:43:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:43:06.072134 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-9e439974-df8c-4713-9225-2ec4c6657b34 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:43:06.072749 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-9e439974-df8c-4713-9225-2ec4c6657b34 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:43:06.080222 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9e439974-df8c-4713-9225-2ec4c6657b34 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:06.080675 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9e439974-df8c-4713-9225-2ec4c6657b34 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:06.081517 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9e439974-df8c-4713-9225-2ec4c6657b34 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:06.081960 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-9e439974-df8c-4713-9225-2ec4c6657b34 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:06.240294 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-9e439974-df8c-4713-9225-2ec4c6657b34 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:43:06.247845 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-9e439974-df8c-4713-9225-2ec4c6657b34 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1574 microversion: 2.1 time: 0.179606 Jun 01 04:43:06.248409 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 585/1156] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:43:06 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1574 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:43:07.266442 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-f2ed5765-7c6d-4386-b204-1e71ef891df5 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:43:07.267591 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-f2ed5765-7c6d-4386-b204-1e71ef891df5 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:43:07.273170 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f2ed5765-7c6d-4386-b204-1e71ef891df5 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:07.273614 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f2ed5765-7c6d-4386-b204-1e71ef891df5 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:07.274419 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f2ed5765-7c6d-4386-b204-1e71ef891df5 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:07.274882 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f2ed5765-7c6d-4386-b204-1e71ef891df5 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:07.420983 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-f2ed5765-7c6d-4386-b204-1e71ef891df5 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:43:07.428893 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-f2ed5765-7c6d-4386-b204-1e71ef891df5 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1574 microversion: 2.1 time: 0.167228 Jun 01 04:43:07.429373 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 572/1157] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:43:07 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:43:07.604740 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-a0c323c2-de5a-45c4-bcbd-b3505ef28007 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-986777436", "imageRef": "14321baa-3ac5-4c53-8054-4945abce5b2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8715975b-1e98-4a30-82e5-baf5c981e463"}], "security_groups": [{"name": "tempest-securitygroup--1188912046"}], "key_name": "tempest-keypair-1587629131", "user_data": "}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:43:07.710456 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.network.neutron [None req-a0c323c2-de5a-45c4-bcbd-b3505ef28007 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] validate_networks() for [('8715975b-1e98-4a30-82e5-baf5c981e463', None, None, None, None, None)] {{(pid=118516) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 01 04:43:08.332061 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-a0c323c2-de5a-45c4-bcbd-b3505ef28007 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Flavor limits 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 01 04:43:08.332512 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-a0c323c2-de5a-45c4-bcbd-b3505ef28007 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Image limits 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 01 04:43:08.332989 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-a0c323c2-de5a-45c4-bcbd-b3505ef28007 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Flavor pref 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 01 04:43:08.333405 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-a0c323c2-de5a-45c4-bcbd-b3505ef28007 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Image pref 0:0:0 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 01 04:43:08.333821 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.virt.hardware [None req-a0c323c2-de5a-45c4-bcbd-b3505ef28007 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 01 04:43:08.343364 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a0c323c2-de5a-45c4-bcbd-b3505ef28007 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:08.343821 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a0c323c2-de5a-45c4-bcbd-b3505ef28007 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:08.344632 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a0c323c2-de5a-45c4-bcbd-b3505ef28007 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:08.345247 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a0c323c2-de5a-45c4-bcbd-b3505ef28007 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:08.362647 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-a0c323c2-de5a-45c4-bcbd-b3505ef28007 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Getting quotas for project 756cb4ed8d2345dcaae27638b257a480. Resources: {'ram', 'instances', 'cores'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:43:08.368738 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-a0c323c2-de5a-45c4-bcbd-b3505ef28007 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Getting quotas for user a17f39a1626d45299666f43be4ffc3ec and project 756cb4ed8d2345dcaae27638b257a480. Resources: {'ram', 'instances', 'cores'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:43:08.379661 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-a0c323c2-de5a-45c4-bcbd-b3505ef28007 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Going to run 1 instances... {{(pid=118516) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 01 04:43:08.381912 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-a0c323c2-de5a-45c4-bcbd-b3505ef28007 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: ab5cfe14-4eed-4104-b042-20724e4ba94f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14321baa-3ac5-4c53-8054-4945abce5b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 01 04:43:08.446134 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-63fb9d06-318e-43be-ba06-9d652020ef89 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:43:08.446778 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-63fb9d06-318e-43be-ba06-9d652020ef89 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:43:08.454024 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-63fb9d06-318e-43be-ba06-9d652020ef89 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:08.454473 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-63fb9d06-318e-43be-ba06-9d652020ef89 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:08.455320 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-63fb9d06-318e-43be-ba06-9d652020ef89 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:08.455771 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-63fb9d06-318e-43be-ba06-9d652020ef89 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:08.511168 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-a0c323c2-de5a-45c4-bcbd-b3505ef28007 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.910972 Jun 01 04:43:08.512076 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 586/1158] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 1 04:43:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 01 04:43:08.523674 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-5127ffe3-362b-4e17-bd7e-8c4558002659 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:43:08.525048 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-5127ffe3-362b-4e17-bd7e-8c4558002659 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: ab5cfe14-4eed-4104-b042-20724e4ba94f] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:43:08.591602 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-5127ffe3-362b-4e17-bd7e-8c4558002659 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:43:08.604333 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-5127ffe3-362b-4e17-bd7e-8c4558002659 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f" status: 200 len: 1241 microversion: 2.1 time: 0.084037 Jun 01 04:43:08.605726 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 587/1159] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:43:08 2022] GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:43:08.647701 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-63fb9d06-318e-43be-ba06-9d652020ef89 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:43:08.662009 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-63fb9d06-318e-43be-ba06-9d652020ef89 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1574 microversion: 2.1 time: 0.219257 Jun 01 04:43:08.674165 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 573/1160] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:43:08 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1574 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:43:09.622150 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-c0212f6e-e0cb-48c5-9f89-eb0722369199 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:43:09.622768 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-c0212f6e-e0cb-48c5-9f89-eb0722369199 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: ab5cfe14-4eed-4104-b042-20724e4ba94f] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:43:09.626824 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:43:09.630408 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c0212f6e-e0cb-48c5-9f89-eb0722369199 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:09.630865 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c0212f6e-e0cb-48c5-9f89-eb0722369199 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:09.631681 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c0212f6e-e0cb-48c5-9f89-eb0722369199 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:09.632121 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c0212f6e-e0cb-48c5-9f89-eb0722369199 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:09.693269 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-2f32f98c-cd02-4a0d-9cd3-0a7dd3dec255 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:43:09.694395 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-2f32f98c-cd02-4a0d-9cd3-0a7dd3dec255 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:43:09.699487 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:43:09.709040 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2f32f98c-cd02-4a0d-9cd3-0a7dd3dec255 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:09.711849 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2f32f98c-cd02-4a0d-9cd3-0a7dd3dec255 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:09.711849 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2f32f98c-cd02-4a0d-9cd3-0a7dd3dec255 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:09.712850 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2f32f98c-cd02-4a0d-9cd3-0a7dd3dec255 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:09.718253 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-c0212f6e-e0cb-48c5-9f89-eb0722369199 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:43:09.726604 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-c0212f6e-e0cb-48c5-9f89-eb0722369199 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f" status: 200 len: 1245 microversion: 2.1 time: 0.108454 Jun 01 04:43:09.727482 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 588/1161] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:43:09 2022] GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f => generated 1245 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:43:09.859105 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-2f32f98c-cd02-4a0d-9cd3-0a7dd3dec255 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:43:09.867469 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-2f32f98c-cd02-4a0d-9cd3-0a7dd3dec255 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1574 microversion: 2.1 time: 0.182307 Jun 01 04:43:09.868029 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 574/1162] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:43:09 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1574 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:43:10.698208 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-32a33493-f051-4036-9647-d7e2fb01196e req-d6127673-348a-4fe6-b929-9c5357372690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba731766-ac3f-4564-8c8a-09a909595ea3", "name": "network-vif-plugged", "status": "completed", "tag": "642b3902-1011-48e3-b526-4497466efc94"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:43:10.717968 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-32a33493-f051-4036-9647-d7e2fb01196e req-d6127673-348a-4fe6-b929-9c5357372690 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:10.717968 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-32a33493-f051-4036-9647-d7e2fb01196e req-d6127673-348a-4fe6-b929-9c5357372690 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:10.726702 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-32a33493-f051-4036-9647-d7e2fb01196e req-d6127673-348a-4fe6-b929-9c5357372690 service nova] Creating event network-vif-plugged:642b3902-1011-48e3-b526-4497466efc94 for instance ba731766-ac3f-4564-8c8a-09a909595ea3 on hv-cinder-66710 Jun 01 04:43:10.732272 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-32a33493-f051-4036-9647-d7e2fb01196e req-d6127673-348a-4fe6-b929-9c5357372690 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039150 Jun 01 04:43:10.732861 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 589/1163] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:43:10.746143 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-5f614ff8-5a18-4c7d-bca5-9953a28c9a1c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:43:10.746644 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-5f614ff8-5a18-4c7d-bca5-9953a28c9a1c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: ab5cfe14-4eed-4104-b042-20724e4ba94f] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:43:10.753272 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5f614ff8-5a18-4c7d-bca5-9953a28c9a1c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:10.753711 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5f614ff8-5a18-4c7d-bca5-9953a28c9a1c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:10.754464 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5f614ff8-5a18-4c7d-bca5-9953a28c9a1c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:10.754893 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5f614ff8-5a18-4c7d-bca5-9953a28c9a1c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:10.831785 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-5f614ff8-5a18-4c7d-bca5-9953a28c9a1c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:43:10.841481 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-5f614ff8-5a18-4c7d-bca5-9953a28c9a1c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f" status: 200 len: 1311 microversion: 2.1 time: 0.100896 Jun 01 04:43:10.842514 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 575/1164] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:43:10 2022] GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f => generated 1311 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:43:10.885662 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-a25f6ebf-ab5e-4fa2-bfc7-93d705d724d8 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:43:10.886601 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-a25f6ebf-ab5e-4fa2-bfc7-93d705d724d8 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:43:10.894205 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a25f6ebf-ab5e-4fa2-bfc7-93d705d724d8 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:10.894935 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a25f6ebf-ab5e-4fa2-bfc7-93d705d724d8 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:10.895475 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a25f6ebf-ab5e-4fa2-bfc7-93d705d724d8 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:10.895914 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a25f6ebf-ab5e-4fa2-bfc7-93d705d724d8 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:11.146588 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-a25f6ebf-ab5e-4fa2-bfc7-93d705d724d8 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:43:11.154878 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-a25f6ebf-ab5e-4fa2-bfc7-93d705d724d8 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1574 microversion: 2.1 time: 0.273960 Jun 01 04:43:11.155480 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 590/1165] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:43:10 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1574 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:43:11.859726 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-14620a0f-41f4-411e-b620-23d12f03c875 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:43:11.860438 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-14620a0f-41f4-411e-b620-23d12f03c875 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: ab5cfe14-4eed-4104-b042-20724e4ba94f] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:43:11.867693 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-14620a0f-41f4-411e-b620-23d12f03c875 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:11.868144 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-14620a0f-41f4-411e-b620-23d12f03c875 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:11.868911 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-14620a0f-41f4-411e-b620-23d12f03c875 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:11.869339 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-14620a0f-41f4-411e-b620-23d12f03c875 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:12.001715 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-14620a0f-41f4-411e-b620-23d12f03c875 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:43:12.009292 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-14620a0f-41f4-411e-b620-23d12f03c875 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f" status: 200 len: 1367 microversion: 2.1 time: 0.154019 Jun 01 04:43:12.009850 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 576/1166] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:43:11 2022] GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:43:12.172888 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-bfc28396-a4c6-4307-9fa4-20107a46ded3 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:43:12.173600 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-bfc28396-a4c6-4307-9fa4-20107a46ded3 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:43:12.180480 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bfc28396-a4c6-4307-9fa4-20107a46ded3 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:12.181046 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bfc28396-a4c6-4307-9fa4-20107a46ded3 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:12.182120 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bfc28396-a4c6-4307-9fa4-20107a46ded3 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:12.182622 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bfc28396-a4c6-4307-9fa4-20107a46ded3 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:12.357212 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-bfc28396-a4c6-4307-9fa4-20107a46ded3 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:43:12.365498 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-bfc28396-a4c6-4307-9fa4-20107a46ded3 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1574 microversion: 2.1 time: 0.196754 Jun 01 04:43:12.366072 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 591/1167] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:43:12 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1574 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:43:12.429286 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-5bbce10e-4d7d-4966-9489-a33ab5705cb0 req-53dfbc55-c007-488a-bf7c-98dfb13d1f42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab5cfe14-4eed-4104-b042-20724e4ba94f", "tag": "7f07b0bb-99cc-422d-a3a7-e17715db910a"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:43:12.438951 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-5bbce10e-4d7d-4966-9489-a33ab5705cb0 req-53dfbc55-c007-488a-bf7c-98dfb13d1f42 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:12.439425 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-5bbce10e-4d7d-4966-9489-a33ab5705cb0 req-53dfbc55-c007-488a-bf7c-98dfb13d1f42 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:12.451264 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-5bbce10e-4d7d-4966-9489-a33ab5705cb0 req-53dfbc55-c007-488a-bf7c-98dfb13d1f42 service nova] Creating event network-changed:7f07b0bb-99cc-422d-a3a7-e17715db910a for instance ab5cfe14-4eed-4104-b042-20724e4ba94f on hv-cinder-66710 Jun 01 04:43:12.457312 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-5bbce10e-4d7d-4966-9489-a33ab5705cb0 req-53dfbc55-c007-488a-bf7c-98dfb13d1f42 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031308 Jun 01 04:43:12.457312 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 577/1168] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:43:13.025943 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-8c1fa413-8da1-4dd6-bdf4-8cc00ae9a4bc tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:43:13.026714 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-8c1fa413-8da1-4dd6-bdf4-8cc00ae9a4bc tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: ab5cfe14-4eed-4104-b042-20724e4ba94f] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:43:13.032953 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8c1fa413-8da1-4dd6-bdf4-8cc00ae9a4bc tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:13.033401 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8c1fa413-8da1-4dd6-bdf4-8cc00ae9a4bc tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:13.034160 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8c1fa413-8da1-4dd6-bdf4-8cc00ae9a4bc tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:13.034595 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8c1fa413-8da1-4dd6-bdf4-8cc00ae9a4bc tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:13.222947 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-8c1fa413-8da1-4dd6-bdf4-8cc00ae9a4bc tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:43:13.230655 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-8c1fa413-8da1-4dd6-bdf4-8cc00ae9a4bc tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f" status: 200 len: 1367 microversion: 2.1 time: 0.208565 Jun 01 04:43:13.231213 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 592/1169] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:43:13 2022] GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:43:13.384882 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-8d8d608c-cc2e-46f1-b91e-d0e3aba1b675 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:43:13.385611 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-8d8d608c-cc2e-46f1-b91e-d0e3aba1b675 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:43:13.392146 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8d8d608c-cc2e-46f1-b91e-d0e3aba1b675 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:13.392608 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8d8d608c-cc2e-46f1-b91e-d0e3aba1b675 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:13.393370 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8d8d608c-cc2e-46f1-b91e-d0e3aba1b675 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:13.393807 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8d8d608c-cc2e-46f1-b91e-d0e3aba1b675 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:13.526545 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-8d8d608c-cc2e-46f1-b91e-d0e3aba1b675 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:43:13.534760 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-8d8d608c-cc2e-46f1-b91e-d0e3aba1b675 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1561 microversion: 2.1 time: 0.154634 Jun 01 04:43:13.535492 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 578/1170] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:43:13 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:43:14.247588 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-b3560c77-a1ab-4110-80ac-437f5f807ead tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:43:14.248109 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-b3560c77-a1ab-4110-80ac-437f5f807ead tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: ab5cfe14-4eed-4104-b042-20724e4ba94f] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:43:14.255320 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b3560c77-a1ab-4110-80ac-437f5f807ead tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:14.255781 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b3560c77-a1ab-4110-80ac-437f5f807ead tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:14.256556 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b3560c77-a1ab-4110-80ac-437f5f807ead tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:14.256998 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-b3560c77-a1ab-4110-80ac-437f5f807ead tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:14.261176 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:43:14.391230 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-b3560c77-a1ab-4110-80ac-437f5f807ead tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:43:14.398585 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-b3560c77-a1ab-4110-80ac-437f5f807ead tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f" status: 200 len: 1367 microversion: 2.1 time: 0.154973 Jun 01 04:43:14.399165 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 593/1171] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:43:14 2022] GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:43:15.415517 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-1058788c-ef8d-4e40-a66a-ad7c96006c58 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:43:15.416365 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-1058788c-ef8d-4e40-a66a-ad7c96006c58 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: ab5cfe14-4eed-4104-b042-20724e4ba94f] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:43:15.418544 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell0:SELECT=4 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:43:15.424102 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1058788c-ef8d-4e40-a66a-ad7c96006c58 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:15.424597 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1058788c-ef8d-4e40-a66a-ad7c96006c58 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:15.425357 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1058788c-ef8d-4e40-a66a-ad7c96006c58 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:15.425791 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-1058788c-ef8d-4e40-a66a-ad7c96006c58 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:15.558915 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-1058788c-ef8d-4e40-a66a-ad7c96006c58 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:43:15.567076 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-1058788c-ef8d-4e40-a66a-ad7c96006c58 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f" status: 200 len: 1367 microversion: 2.1 time: 0.155425 Jun 01 04:43:15.567662 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 579/1172] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:43:15 2022] GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:43:16.584614 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-1e2d68e2-39ae-44f9-967b-4ddf782313e1 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:43:16.585229 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-1e2d68e2-39ae-44f9-967b-4ddf782313e1 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: ab5cfe14-4eed-4104-b042-20724e4ba94f] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:43:16.591790 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1e2d68e2-39ae-44f9-967b-4ddf782313e1 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:16.592239 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1e2d68e2-39ae-44f9-967b-4ddf782313e1 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:16.593000 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1e2d68e2-39ae-44f9-967b-4ddf782313e1 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:16.598261 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1e2d68e2-39ae-44f9-967b-4ddf782313e1 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:16.722416 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-1e2d68e2-39ae-44f9-967b-4ddf782313e1 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:43:16.730178 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-1e2d68e2-39ae-44f9-967b-4ddf782313e1 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f" status: 200 len: 1367 microversion: 2.1 time: 0.149427 Jun 01 04:43:16.730749 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 594/1173] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:43:16 2022] GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:43:17.746887 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-3770a651-2be7-4335-87e3-44972aa604b6 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:43:17.747531 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-3770a651-2be7-4335-87e3-44972aa604b6 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: ab5cfe14-4eed-4104-b042-20724e4ba94f] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:43:17.754313 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3770a651-2be7-4335-87e3-44972aa604b6 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:17.754766 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3770a651-2be7-4335-87e3-44972aa604b6 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:17.755566 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3770a651-2be7-4335-87e3-44972aa604b6 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:17.756013 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-3770a651-2be7-4335-87e3-44972aa604b6 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:17.882527 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-3770a651-2be7-4335-87e3-44972aa604b6 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:43:17.890051 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-3770a651-2be7-4335-87e3-44972aa604b6 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f" status: 200 len: 1367 microversion: 2.1 time: 0.146992 Jun 01 04:43:17.891268 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 580/1174] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:43:17 2022] GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:43:18.907586 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-20572432-939c-403f-aee9-7e5776e28ae4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:43:18.908304 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-20572432-939c-403f-aee9-7e5776e28ae4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: ab5cfe14-4eed-4104-b042-20724e4ba94f] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:43:18.910916 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell0:SELECT=2 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:43:18.911749 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell0:SELECT=8 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:43:18.917400 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-20572432-939c-403f-aee9-7e5776e28ae4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:18.918227 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-20572432-939c-403f-aee9-7e5776e28ae4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:18.918404 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-20572432-939c-403f-aee9-7e5776e28ae4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:18.918825 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-20572432-939c-403f-aee9-7e5776e28ae4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:19.057863 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-20572432-939c-403f-aee9-7e5776e28ae4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:43:19.065416 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-20572432-939c-403f-aee9-7e5776e28ae4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f" status: 200 len: 1367 microversion: 2.1 time: 0.162354 Jun 01 04:43:19.065995 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 595/1175] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:43:18 2022] GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:43:20.084399 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-891d7a05-4fb6-4e56-830c-dc8344d0a884 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:43:20.085806 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-891d7a05-4fb6-4e56-830c-dc8344d0a884 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: ab5cfe14-4eed-4104-b042-20724e4ba94f] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:43:20.091826 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-891d7a05-4fb6-4e56-830c-dc8344d0a884 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:20.092277 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-891d7a05-4fb6-4e56-830c-dc8344d0a884 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:20.093045 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-891d7a05-4fb6-4e56-830c-dc8344d0a884 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:20.093482 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-891d7a05-4fb6-4e56-830c-dc8344d0a884 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:20.228285 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-891d7a05-4fb6-4e56-830c-dc8344d0a884 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:43:20.236285 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-891d7a05-4fb6-4e56-830c-dc8344d0a884 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f" status: 200 len: 1367 microversion: 2.1 time: 0.155773 Jun 01 04:43:20.236842 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 581/1176] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:43:20 2022] GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:43:20.856825 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-b63eaac0-0c32-4f7e-9dcc-ed056fc62f5b req-7662546e-9fba-40ec-b464-cf4ba7351392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab5cfe14-4eed-4104-b042-20724e4ba94f", "name": "network-vif-plugged", "status": "completed", "tag": "7f07b0bb-99cc-422d-a3a7-e17715db910a"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:43:20.867224 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-b63eaac0-0c32-4f7e-9dcc-ed056fc62f5b req-7662546e-9fba-40ec-b464-cf4ba7351392 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:20.867224 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-b63eaac0-0c32-4f7e-9dcc-ed056fc62f5b req-7662546e-9fba-40ec-b464-cf4ba7351392 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:20.876682 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-b63eaac0-0c32-4f7e-9dcc-ed056fc62f5b req-7662546e-9fba-40ec-b464-cf4ba7351392 service nova] Creating event network-vif-plugged:7f07b0bb-99cc-422d-a3a7-e17715db910a for instance ab5cfe14-4eed-4104-b042-20724e4ba94f on hv-cinder-66710 Jun 01 04:43:20.881608 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-b63eaac0-0c32-4f7e-9dcc-ed056fc62f5b req-7662546e-9fba-40ec-b464-cf4ba7351392 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028466 Jun 01 04:43:20.882221 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 596/1177] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:43:21.253630 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-60969b0f-9044-4cf6-96ac-54b614b58513 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:43:21.254266 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-60969b0f-9044-4cf6-96ac-54b614b58513 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: ab5cfe14-4eed-4104-b042-20724e4ba94f] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:43:21.260648 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-60969b0f-9044-4cf6-96ac-54b614b58513 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:21.261095 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-60969b0f-9044-4cf6-96ac-54b614b58513 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:21.261854 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-60969b0f-9044-4cf6-96ac-54b614b58513 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:21.262283 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-60969b0f-9044-4cf6-96ac-54b614b58513 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:21.282394 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:43:21.398508 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-60969b0f-9044-4cf6-96ac-54b614b58513 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:43:21.406735 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-60969b0f-9044-4cf6-96ac-54b614b58513 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f" status: 200 len: 1367 microversion: 2.1 time: 0.157507 Jun 01 04:43:21.407318 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 582/1178] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:43:21 2022] GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:43:22.425956 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-a965fafa-6e9c-4dd7-ad59-23732daea0bf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:43:22.426646 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-a965fafa-6e9c-4dd7-ad59-23732daea0bf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: ab5cfe14-4eed-4104-b042-20724e4ba94f] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:43:22.432809 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a965fafa-6e9c-4dd7-ad59-23732daea0bf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:22.433255 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a965fafa-6e9c-4dd7-ad59-23732daea0bf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:22.434020 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a965fafa-6e9c-4dd7-ad59-23732daea0bf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:22.434452 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-a965fafa-6e9c-4dd7-ad59-23732daea0bf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:22.562927 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-a965fafa-6e9c-4dd7-ad59-23732daea0bf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:43:22.570584 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-a965fafa-6e9c-4dd7-ad59-23732daea0bf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f" status: 200 len: 1367 microversion: 2.1 time: 0.149664 Jun 01 04:43:22.571149 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 597/1179] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:43:22 2022] GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:43:23.588005 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-e4e9f015-296e-4e04-8ef7-ca177cca8214 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:43:23.588640 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-e4e9f015-296e-4e04-8ef7-ca177cca8214 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: ab5cfe14-4eed-4104-b042-20724e4ba94f] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:43:23.596458 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e4e9f015-296e-4e04-8ef7-ca177cca8214 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:23.596895 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e4e9f015-296e-4e04-8ef7-ca177cca8214 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:23.597654 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e4e9f015-296e-4e04-8ef7-ca177cca8214 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:23.598082 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e4e9f015-296e-4e04-8ef7-ca177cca8214 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:23.733459 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-e4e9f015-296e-4e04-8ef7-ca177cca8214 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:43:23.741968 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-e4e9f015-296e-4e04-8ef7-ca177cca8214 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f" status: 200 len: 1557 microversion: 2.1 time: 0.157854 Jun 01 04:43:23.742530 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 583/1180] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:43:23 2022] GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:43:23.758001 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-8e0230fe-cebe-4f23-9136-811f50793063 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:43:23.758501 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-8e0230fe-cebe-4f23-9136-811f50793063 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: ab5cfe14-4eed-4104-b042-20724e4ba94f] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:43:23.764932 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8e0230fe-cebe-4f23-9136-811f50793063 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:23.765383 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8e0230fe-cebe-4f23-9136-811f50793063 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:23.766831 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8e0230fe-cebe-4f23-9136-811f50793063 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:23.767279 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-8e0230fe-cebe-4f23-9136-811f50793063 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:23.847322 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-8e0230fe-cebe-4f23-9136-811f50793063 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093066 Jun 01 04:43:23.848077 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 598/1181] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Jun 1 04:43:23 2022] GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:43:24.865401 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-2a14d574-6381-4bf7-962d-4b677156f579 req-336be50c-77d5-4229-a69e-96e96e2bc3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab5cfe14-4eed-4104-b042-20724e4ba94f", "tag": "7f07b0bb-99cc-422d-a3a7-e17715db910a"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:43:24.869056 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-2a14d574-6381-4bf7-962d-4b677156f579 req-336be50c-77d5-4229-a69e-96e96e2bc3c4 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:43:24.869504 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-2a14d574-6381-4bf7-962d-4b677156f579 req-336be50c-77d5-4229-a69e-96e96e2bc3c4 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:43:24.880470 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-2a14d574-6381-4bf7-962d-4b677156f579 req-336be50c-77d5-4229-a69e-96e96e2bc3c4 service nova] Creating event network-changed:7f07b0bb-99cc-422d-a3a7-e17715db910a for instance ab5cfe14-4eed-4104-b042-20724e4ba94f on hv-cinder-66710 Jun 01 04:43:24.886137 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-2a14d574-6381-4bf7-962d-4b677156f579 req-336be50c-77d5-4229-a69e-96e96e2bc3c4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030017 Jun 01 04:43:24.886811 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 584/1182] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:44:18.598235 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 01 04:44:18.598852 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Wed Jun 1 04:44:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 01 04:44:21.162940 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 01 04:44:21.163520 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Wed Jun 1 04:44:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 01 04:44:39.810367 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_api:SELECT=21 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:44:39.811338 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=28 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:44:39.871749 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-1c95b05f-5e4a-46c1-89b0-05609961564e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:44:39.872252 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-1c95b05f-5e4a-46c1-89b0-05609961564e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: ab5cfe14-4eed-4104-b042-20724e4ba94f] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:44:39.878763 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1c95b05f-5e4a-46c1-89b0-05609961564e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:39.879147 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1c95b05f-5e4a-46c1-89b0-05609961564e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:39.880017 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1c95b05f-5e4a-46c1-89b0-05609961564e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:39.880453 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-1c95b05f-5e4a-46c1-89b0-05609961564e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:39.903602 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-1c95b05f-5e4a-46c1-89b0-05609961564e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f/ips" status: 200 len: 150 microversion: 2.1 time: 0.096278 Jun 01 04:44:39.904169 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 599/1183] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jun 1 04:44:39 2022] GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f/ips => generated 150 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:44:42.514489 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_api:SELECT=21 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:44:42.516085 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=10 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:44:42.520702 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-da0d3b75-29d3-4c4b-b32a-8b9466810b76 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aacf9a39-c393-4aa3-b93f-2061909901a5"}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:44:42.521832 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-da0d3b75-29d3-4c4b-b32a-8b9466810b76 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: ab5cfe14-4eed-4104-b042-20724e4ba94f] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:44:42.527980 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-da0d3b75-29d3-4c4b-b32a-8b9466810b76 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:42.533583 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-da0d3b75-29d3-4c4b-b32a-8b9466810b76 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:42.533583 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-da0d3b75-29d3-4c4b-b32a-8b9466810b76 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:42.533583 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-da0d3b75-29d3-4c4b-b32a-8b9466810b76 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:43.316727 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-da0d3b75-29d3-4c4b-b32a-8b9466810b76 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "POST /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.803996 Jun 01 04:44:43.317351 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 585/1184] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 1 04:44:42 2022] POST /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f/os-volume_attachments => generated 194 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:44:43.808724 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-008c8001-02cc-46e0-8fbb-22f0658c7606 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:44:43.809273 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-008c8001-02cc-46e0-8fbb-22f0658c7606 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:44:43.823285 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-008c8001-02cc-46e0-8fbb-22f0658c7606 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:43.823851 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-008c8001-02cc-46e0-8fbb-22f0658c7606 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:43.824702 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-008c8001-02cc-46e0-8fbb-22f0658c7606 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:43.825210 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-008c8001-02cc-46e0-8fbb-22f0658c7606 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:43.854753 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-008c8001-02cc-46e0-8fbb-22f0658c7606 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Going to try to terminate instance {{(pid=118516) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 01 04:44:43.882679 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-99de2916-5859-4e63-98e2-ef4a5b35f894 req-62405a32-0c73-4ec1-80e2-1567b0e394f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba731766-ac3f-4564-8c8a-09a909595ea3", "tag": "642b3902-1011-48e3-b526-4497466efc94"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:44:43.891279 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-99de2916-5859-4e63-98e2-ef4a5b35f894 req-62405a32-0c73-4ec1-80e2-1567b0e394f8 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:43.892069 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-99de2916-5859-4e63-98e2-ef4a5b35f894 req-62405a32-0c73-4ec1-80e2-1567b0e394f8 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:43.903217 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-99de2916-5859-4e63-98e2-ef4a5b35f894 req-62405a32-0c73-4ec1-80e2-1567b0e394f8 service nova] Creating event network-changed:642b3902-1011-48e3-b526-4497466efc94 for instance ba731766-ac3f-4564-8c8a-09a909595ea3 on hv-cinder-66710 Jun 01 04:44:43.908996 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-99de2916-5859-4e63-98e2-ef4a5b35f894 req-62405a32-0c73-4ec1-80e2-1567b0e394f8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098202 Jun 01 04:44:43.909781 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 586/1185] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:44:44.199341 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-008c8001-02cc-46e0-8fbb-22f0658c7606 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 204 len: 0 microversion: 2.1 time: 0.394081 Jun 01 04:44:44.200236 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 600/1186] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 1 04:44:43 2022] DELETE /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 01 04:44:44.209171 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-0ab36484-e9d3-4bd0-b5cd-9b160132c9bd tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:44:44.214626 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-0ab36484-e9d3-4bd0-b5cd-9b160132c9bd tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:44:44.216609 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0ab36484-e9d3-4bd0-b5cd-9b160132c9bd tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:44.217065 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0ab36484-e9d3-4bd0-b5cd-9b160132c9bd tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:44.217842 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0ab36484-e9d3-4bd0-b5cd-9b160132c9bd tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:44.218362 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-0ab36484-e9d3-4bd0-b5cd-9b160132c9bd tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:44.353542 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-0ab36484-e9d3-4bd0-b5cd-9b160132c9bd tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:44:44.361593 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-0ab36484-e9d3-4bd0-b5cd-9b160132c9bd tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1567 microversion: 2.1 time: 0.156666 Jun 01 04:44:44.362168 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 587/1187] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:44:44 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:44:45.380359 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-f4cc351f-f7b4-4355-a3ab-e0260b025520 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:44:45.381060 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-f4cc351f-f7b4-4355-a3ab-e0260b025520 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:44:45.387520 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f4cc351f-f7b4-4355-a3ab-e0260b025520 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:45.387974 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f4cc351f-f7b4-4355-a3ab-e0260b025520 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:45.388748 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f4cc351f-f7b4-4355-a3ab-e0260b025520 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:45.389189 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-f4cc351f-f7b4-4355-a3ab-e0260b025520 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:45.592039 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-f4cc351f-f7b4-4355-a3ab-e0260b025520 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:44:45.602013 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-f4cc351f-f7b4-4355-a3ab-e0260b025520 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1567 microversion: 2.1 time: 0.225882 Jun 01 04:44:45.602596 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 601/1188] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:44:45 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1567 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:44:46.620034 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-66238b1f-75e8-4045-bb48-a80ef90c597d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:44:46.620743 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-66238b1f-75e8-4045-bb48-a80ef90c597d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:44:46.628394 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-66238b1f-75e8-4045-bb48-a80ef90c597d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:46.628872 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-66238b1f-75e8-4045-bb48-a80ef90c597d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:46.629726 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-66238b1f-75e8-4045-bb48-a80ef90c597d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:46.630239 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-66238b1f-75e8-4045-bb48-a80ef90c597d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:46.658360 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-5b62e735-1f57-4260-86e2-4bc74d2ee8b7 req-2e05718f-fbcf-4fc3-9583-995cdfb61ecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba731766-ac3f-4564-8c8a-09a909595ea3", "name": "network-vif-deleted", "tag": "642b3902-1011-48e3-b526-4497466efc94"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:44:46.666748 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-5b62e735-1f57-4260-86e2-4bc74d2ee8b7 req-2e05718f-fbcf-4fc3-9583-995cdfb61ecb service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:46.667197 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-5b62e735-1f57-4260-86e2-4bc74d2ee8b7 req-2e05718f-fbcf-4fc3-9583-995cdfb61ecb service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:46.679040 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-5b62e735-1f57-4260-86e2-4bc74d2ee8b7 req-2e05718f-fbcf-4fc3-9583-995cdfb61ecb service nova] Creating event network-vif-deleted:642b3902-1011-48e3-b526-4497466efc94 for instance ba731766-ac3f-4564-8c8a-09a909595ea3 on hv-cinder-66710 Jun 01 04:44:46.684006 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-5b62e735-1f57-4260-86e2-4bc74d2ee8b7 req-2e05718f-fbcf-4fc3-9583-995cdfb61ecb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029322 Jun 01 04:44:46.684606 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 602/1189] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:44:46.698138 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-66238b1f-75e8-4045-bb48-a80ef90c597d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:44:46.705797 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-66238b1f-75e8-4045-bb48-a80ef90c597d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1381 microversion: 2.1 time: 0.089827 Jun 01 04:44:46.706345 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 588/1190] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:44:46 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1381 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:44:47.724108 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-99ab1aaf-0205-4017-92b5-564aa84cd27d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:44:47.724729 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-99ab1aaf-0205-4017-92b5-564aa84cd27d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:44:47.731396 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-99ab1aaf-0205-4017-92b5-564aa84cd27d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:47.731853 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-99ab1aaf-0205-4017-92b5-564aa84cd27d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:47.732622 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-99ab1aaf-0205-4017-92b5-564aa84cd27d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:47.733075 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-99ab1aaf-0205-4017-92b5-564aa84cd27d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:47.765031 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-99ab1aaf-0205-4017-92b5-564aa84cd27d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:47.766115 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-99ab1aaf-0205-4017-92b5-564aa84cd27d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:47.766572 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.objects.instance [None req-99ab1aaf-0205-4017-92b5-564aa84cd27d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lazy-loading 'fault' on Instance uuid ba731766-ac3f-4564-8c8a-09a909595ea3 {{(pid=118516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:44:47.811786 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-99ab1aaf-0205-4017-92b5-564aa84cd27d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b4ed73a96143098d2c64384233d539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d70e82d96624016bed251b30b26ad73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:44:47.819867 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-99ab1aaf-0205-4017-92b5-564aa84cd27d tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 200 len: 1224 microversion: 2.1 time: 0.100495 Jun 01 04:44:47.820440 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 603/1191] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:44:47 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:44:48.837132 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-f301fe49-f855-4fe0-921f-e86593d5ab96 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:44:48.837728 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-f301fe49-f855-4fe0-921f-e86593d5ab96 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] [instance: ba731766-ac3f-4564-8c8a-09a909595ea3] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:44:48.844976 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f301fe49-f855-4fe0-921f-e86593d5ab96 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:48.845433 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f301fe49-f855-4fe0-921f-e86593d5ab96 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:48.846206 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f301fe49-f855-4fe0-921f-e86593d5ab96 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:48.846640 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-f301fe49-f855-4fe0-921f-e86593d5ab96 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:48.860728 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.wsgi [None req-f301fe49-f855-4fe0-921f-e86593d5ab96 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] HTTP exception thrown: Instance ba731766-ac3f-4564-8c8a-09a909595ea3 could not be found. Jun 01 04:44:48.862297 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-f301fe49-f855-4fe0-921f-e86593d5ab96 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Request method failure captured: Jun 01 04:44:48.862297 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: request: GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 HTTP/1.1 Jun 01 04:44:48.862297 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept: application/json Jun 01 04:44:48.862297 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept-Encoding: identity Jun 01 04:44:48.862297 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Connection: close Jun 01 04:44:48.862297 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Length: 0 Jun 01 04:44:48.862297 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Type: application/json Jun 01 04:44:48.862297 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Host: 10.222.0.18 Jun 01 04:44:48.862297 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Openstack-System-Scope: None Jun 01 04:44:48.862297 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: User-Agent: python-urllib3/1.26.9 Jun 01 04:44:48.862297 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Auth-Token: gAAAAABilu12FWFh_kZ4kEZHVempmHRKzoIHmsgiHTOrclhnnsenWZBhGMdi25zZUlbi56LP7I9x_S3FijN6Jn4ujEvgso9v2eCUV-P00sayLbJudUPbeSpCet5dqYTIbk9LrAoMhnIi7eqvAKSAyLBF24rysAgEETFM3oKiy7C7uXtq3nCn_9Y Jun 01 04:44:48.862297 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Id: None Jun 01 04:44:48.862297 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Name: None Jun 01 04:44:48.862297 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Identity-Status: Confirmed Jun 01 04:44:48.862297 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Is-Admin-Project: True Jun 01 04:44:48.862297 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Id: default Jun 01 04:44:48.862297 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Name: Default Jun 01 04:44:48.862297 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Id: 6d70e82d96624016bed251b30b26ad73 Jun 01 04:44:48.862297 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Name: tempest-TestShelveInstance-1522410496 Jun 01 04:44:48.862297 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Role: reader,member Jun 01 04:44:48.862297 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Roles: reader,member Jun 01 04:44:48.863843 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6d70e82d96624016bed251b30b26ad73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6d70e82d96624016bed251b30b26ad73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6d70e82d96624016bed251b30b26ad73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6d70e82d96624016bed251b30b26ad73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:44:48.863843 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant: tempest-TestShelveInstance-1522410496 Jun 01 04:44:48.863843 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Id: 6d70e82d96624016bed251b30b26ad73 Jun 01 04:44:48.863843 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Name: tempest-TestShelveInstance-1522410496 Jun 01 04:44:48.863843 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User: tempest-TestShelveInstance-1522410496-project Jun 01 04:44:48.863843 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Id: default Jun 01 04:44:48.863843 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Name: Default Jun 01 04:44:48.863843 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Id: 44b4ed73a96143098d2c64384233d539 Jun 01 04:44:48.863843 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Name: tempest-TestShelveInstance-1522410496-project Jun 01 04:44:48.863843 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: method: > Jun 01 04:44:48.863843 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: exception: Instance ba731766-ac3f-4564-8c8a-09a909595ea3 could not be found. Jun 01 04:44:48.863843 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: action_args: {'id': 'ba731766-ac3f-4564-8c8a-09a909595ea3'} Jun 01 04:44:48.864758 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:44:48.864758 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:44:48.864758 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:44:48.864758 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:44:48.864758 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:44:48.864758 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:44:48.864758 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:44:48.864758 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:44:48.864758 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:44:48.864758 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:44:48.864758 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba731766-ac3f-4564-8c8a-09a909595ea3 could not be found. Jun 01 04:44:48.864758 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:44:48.864758 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:44:48.864758 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:44:48.864758 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:44:48.864758 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:44:48.864758 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:44:48.864758 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:44:48.864758 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:44:48.864758 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:44:48.867330 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:44:48.867330 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 01 04:44:48.867330 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 01 04:44:48.867330 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:44:48.867330 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:44:48.867330 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:44:48.867330 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:44:48.867330 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba731766-ac3f-4564-8c8a-09a909595ea3 could not be found. Jun 01 04:44:48.867330 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:44:48.867330 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:44:48.867330 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:44:48.867330 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:44:48.867330 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:44:48.867330 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:44:48.867330 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:44:48.867330 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:44:48.867330 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba731766-ac3f-4564-8c8a-09a909595ea3 could not be found. Jun 01 04:44:48.867330 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:44:48.869384 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-f301fe49-f855-4fe0-921f-e86593d5ab96 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Returning 404 to user: Instance ba731766-ac3f-4564-8c8a-09a909595ea3 could not be found. {{(pid=118517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:44:48.869384 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-f301fe49-f855-4fe0-921f-e86593d5ab96 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3" status: 404 len: 111 microversion: 2.1 time: 0.030433 Jun 01 04:44:48.869384 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 589/1192] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:44:48 2022] GET /compute/v2.1/servers/ba731766-ac3f-4564-8c8a-09a909595ea3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:44:49.092946 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-7e6cf078-54dc-4926-8f50-5adf1f09c915 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] Calling method '.version_select at 0x7ff325824c10>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:44:49.180979 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-7e6cf078-54dc-4926-8f50-5adf1f09c915 tempest-TestShelveInstance-1522410496 tempest-TestShelveInstance-1522410496-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1065823219" status: 202 len: 0 microversion: 2.1 time: 0.091944 Jun 01 04:44:49.181677 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 604/1193] 10.222.0.18 () {58 vars in 1253 bytes} [Wed Jun 1 04:44:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1065823219 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 01 04:44:51.910951 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-073a8de9-8681-4259-b123-335b7b54dbc4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aacf9a39-c393-4aa3-b93f-2061909901a5"}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:44:51.912716 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-073a8de9-8681-4259-b123-335b7b54dbc4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: ab5cfe14-4eed-4104-b042-20724e4ba94f] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:44:51.920871 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-073a8de9-8681-4259-b123-335b7b54dbc4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:51.921859 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-073a8de9-8681-4259-b123-335b7b54dbc4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:51.922667 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-073a8de9-8681-4259-b123-335b7b54dbc4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:51.923098 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-073a8de9-8681-4259-b123-335b7b54dbc4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:52.014234 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.wsgi [None req-073a8de9-8681-4259-b123-335b7b54dbc4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] HTTP exception thrown: Invalid volume: volume aacf9a39-c393-4aa3-b93f-2061909901a5 is already attached to instances: ab5cfe14-4eed-4104-b042-20724e4ba94f Jun 01 04:44:52.015901 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-073a8de9-8681-4259-b123-335b7b54dbc4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Request method failure captured: Jun 01 04:44:52.015901 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: request: POST /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f/os-volume_attachments HTTP/1.1 Jun 01 04:44:52.015901 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept: application/json Jun 01 04:44:52.015901 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept-Encoding: identity Jun 01 04:44:52.015901 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Connection: close Jun 01 04:44:52.015901 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Length: 74 Jun 01 04:44:52.015901 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Type: application/json Jun 01 04:44:52.015901 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Host: 10.222.0.18 Jun 01 04:44:52.015901 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Openstack-System-Scope: None Jun 01 04:44:52.015901 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: User-Agent: python-urllib3/1.26.9 Jun 01 04:44:52.015901 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Auth-Token: gAAAAABilu106jtQ5FQFoI4uiqXA9VQRHJyx7H5fGGtMI-QLhZ9wzEW4QntKBbHMyg13vDMrRhGraMRm2tDoM-Qty4nj0NCDDE4r_xFFVOkMZvSyYWVAglaTnBtH6geTi9BY7b2EpB-efWXbewEEXtidDt5wGfiLJoigjqd8nO6N2RC-Av-UzW8 Jun 01 04:44:52.015901 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Id: None Jun 01 04:44:52.015901 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Name: None Jun 01 04:44:52.015901 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Identity-Status: Confirmed Jun 01 04:44:52.015901 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Is-Admin-Project: True Jun 01 04:44:52.015901 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Id: default Jun 01 04:44:52.015901 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Name: Default Jun 01 04:44:52.015901 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Id: 756cb4ed8d2345dcaae27638b257a480 Jun 01 04:44:52.015901 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Name: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:44:52.015901 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Role: reader,member Jun 01 04:44:52.015901 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Roles: reader,member Jun 01 04:44:52.017634 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:44:52.017634 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:44:52.017634 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Id: 756cb4ed8d2345dcaae27638b257a480 Jun 01 04:44:52.017634 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:44:52.017634 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User: tempest-AttachVolumeNegativeTest-373300167-project Jun 01 04:44:52.017634 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Id: default Jun 01 04:44:52.017634 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Name: Default Jun 01 04:44:52.017634 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Id: a17f39a1626d45299666f43be4ffc3ec Jun 01 04:44:52.017634 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Name: tempest-AttachVolumeNegativeTest-373300167-project Jun 01 04:44:52.017634 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Jun 01 04:44:52.017634 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {"volumeAttachment": {"volumeId": "aacf9a39-c393-4aa3-b93f-2061909901a5"}} Jun 01 04:44:52.017634 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: method: > Jun 01 04:44:52.018632 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: exception: Invalid volume: volume aacf9a39-c393-4aa3-b93f-2061909901a5 is already attached to instances: ab5cfe14-4eed-4104-b042-20724e4ba94f Jun 01 04:44:52.018632 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: action_args: {'server_id': 'ab5cfe14-4eed-4104-b042-20724e4ba94f', 'body': {'volumeAttachment': {'volumeId': 'aacf9a39-c393-4aa3-b93f-2061909901a5'}}} Jun 01 04:44:52.018632 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:44:52.018632 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:44:52.018632 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 01 04:44:52.018632 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 01 04:44:52.018632 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 01 04:44:52.018632 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 01 04:44:52.018632 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 01 04:44:52.018632 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 01 04:44:52.018632 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 01 04:44:52.018632 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 01 04:44:52.018632 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 01 04:44:52.018632 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 01 04:44:52.018632 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume aacf9a39-c393-4aa3-b93f-2061909901a5 is already attached to instances: ab5cfe14-4eed-4104-b042-20724e4ba94f Jun 01 04:44:52.018632 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:44:52.018632 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:44:52.018632 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:44:52.018632 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:44:52.020205 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:44:52.020205 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:44:52.020205 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:44:52.020205 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:44:52.020205 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:44:52.020205 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:44:52.020205 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 01 04:44:52.020205 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 01 04:44:52.020205 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 01 04:44:52.020205 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 01 04:44:52.020205 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 01 04:44:52.020205 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 01 04:44:52.020205 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 01 04:44:52.020205 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 01 04:44:52.020205 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume aacf9a39-c393-4aa3-b93f-2061909901a5 is already attached to instances: ab5cfe14-4eed-4104-b042-20724e4ba94f Jun 01 04:44:52.020205 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:44:52.020205 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:44:52.020205 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:44:52.020205 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:44:52.020205 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:44:52.021949 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:44:52.021949 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:44:52.021949 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:44:52.021949 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume aacf9a39-c393-4aa3-b93f-2061909901a5 is already attached to instances: ab5cfe14-4eed-4104-b042-20724e4ba94f Jun 01 04:44:52.021949 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:44:52.021949 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-073a8de9-8681-4259-b123-335b7b54dbc4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Returning 400 to user: Invalid volume: volume aacf9a39-c393-4aa3-b93f-2061909901a5 is already attached to instances: ab5cfe14-4eed-4104-b042-20724e4ba94f {{(pid=118517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:44:52.021949 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-073a8de9-8681-4259-b123-335b7b54dbc4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "POST /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111925 Jun 01 04:44:52.021949 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 590/1194] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 1 04:44:51 2022] POST /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f/os-volume_attachments => generated 174 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 01 04:44:52.089073 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-462e6371-c818-480b-82d5-11b7d780cd64 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:44:52.089636 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-462e6371-c818-480b-82d5-11b7d780cd64 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: ab5cfe14-4eed-4104-b042-20724e4ba94f] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:44:52.099071 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-462e6371-c818-480b-82d5-11b7d780cd64 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:52.099568 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-462e6371-c818-480b-82d5-11b7d780cd64 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:52.100608 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-462e6371-c818-480b-82d5-11b7d780cd64 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:52.101071 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-462e6371-c818-480b-82d5-11b7d780cd64 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:52.182324 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.objects.instance [None req-462e6371-c818-480b-82d5-11b7d780cd64 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lazy-loading 'services' on Instance uuid ab5cfe14-4eed-4104-b042-20724e4ba94f {{(pid=118516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:44:52.449926 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-462e6371-c818-480b-82d5-11b7d780cd64 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f/os-volume_attachments/aacf9a39-c393-4aa3-b93f-2061909901a5" status: 202 len: 0 microversion: 2.1 time: 0.365151 Jun 01 04:44:52.450647 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 605/1195] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 1 04:44:52 2022] DELETE /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f/os-volume_attachments/aacf9a39-c393-4aa3-b93f-2061909901a5 => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 01 04:44:52.459909 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-686ad8e7-f3be-4ac4-b4e8-8bc86043ddf7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:44:52.461147 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-686ad8e7-f3be-4ac4-b4e8-8bc86043ddf7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: ab5cfe14-4eed-4104-b042-20724e4ba94f] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:44:52.468077 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-686ad8e7-f3be-4ac4-b4e8-8bc86043ddf7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:52.468763 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-686ad8e7-f3be-4ac4-b4e8-8bc86043ddf7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:52.469839 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-686ad8e7-f3be-4ac4-b4e8-8bc86043ddf7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:52.470350 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-686ad8e7-f3be-4ac4-b4e8-8bc86043ddf7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:52.505231 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-686ad8e7-f3be-4ac4-b4e8-8bc86043ddf7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049935 Jun 01 04:44:52.505802 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 591/1196] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 1 04:44:52 2022] GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:44:53.522694 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-920a1246-2883-46bc-a986-3adddc00641c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:44:53.523941 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-920a1246-2883-46bc-a986-3adddc00641c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: ab5cfe14-4eed-4104-b042-20724e4ba94f] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:44:53.533815 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-920a1246-2883-46bc-a986-3adddc00641c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:53.534615 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-920a1246-2883-46bc-a986-3adddc00641c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:53.535485 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-920a1246-2883-46bc-a986-3adddc00641c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:53.535916 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-920a1246-2883-46bc-a986-3adddc00641c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:53.576509 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-920a1246-2883-46bc-a986-3adddc00641c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062865 Jun 01 04:44:53.610175 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 606/1197] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 1 04:44:53 2022] GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:44:54.620176 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-637df5e1-258a-4c76-b2f7-de01e6356b88 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:44:54.621333 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-637df5e1-258a-4c76-b2f7-de01e6356b88 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: ab5cfe14-4eed-4104-b042-20724e4ba94f] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:44:54.628651 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-637df5e1-258a-4c76-b2f7-de01e6356b88 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:54.631886 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-637df5e1-258a-4c76-b2f7-de01e6356b88 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:54.631886 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-637df5e1-258a-4c76-b2f7-de01e6356b88 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:54.631886 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-637df5e1-258a-4c76-b2f7-de01e6356b88 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:54.666089 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-637df5e1-258a-4c76-b2f7-de01e6356b88 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049972 Jun 01 04:44:54.666695 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 592/1198] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 1 04:44:54 2022] GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 01 04:44:54.725358 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-0f06c870-e12c-4c16-a81e-799e55736c14 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:44:54.725941 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-0f06c870-e12c-4c16-a81e-799e55736c14 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: ab5cfe14-4eed-4104-b042-20724e4ba94f] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:44:54.736443 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0f06c870-e12c-4c16-a81e-799e55736c14 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:54.736904 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0f06c870-e12c-4c16-a81e-799e55736c14 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:54.737701 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0f06c870-e12c-4c16-a81e-799e55736c14 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:54.738137 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0f06c870-e12c-4c16-a81e-799e55736c14 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:54.763978 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-0f06c870-e12c-4c16-a81e-799e55736c14 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: ab5cfe14-4eed-4104-b042-20724e4ba94f] Going to try to terminate instance {{(pid=118516) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 01 04:44:55.114965 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-0f06c870-e12c-4c16-a81e-799e55736c14 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f" status: 204 len: 0 microversion: 2.1 time: 0.391445 Jun 01 04:44:55.120735 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 607/1199] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 1 04:44:54 2022] DELETE /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 01 04:44:55.124057 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-75939288-559f-4496-8fda-e0f2ff7fad30 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:44:55.125173 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-75939288-559f-4496-8fda-e0f2ff7fad30 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: ab5cfe14-4eed-4104-b042-20724e4ba94f] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:44:55.131557 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-75939288-559f-4496-8fda-e0f2ff7fad30 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:55.132011 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-75939288-559f-4496-8fda-e0f2ff7fad30 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:55.132839 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-75939288-559f-4496-8fda-e0f2ff7fad30 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:55.133275 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-75939288-559f-4496-8fda-e0f2ff7fad30 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:55.285512 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-75939288-559f-4496-8fda-e0f2ff7fad30 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:44:55.293926 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-75939288-559f-4496-8fda-e0f2ff7fad30 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f" status: 200 len: 1682 microversion: 2.1 time: 0.173847 Jun 01 04:44:55.294486 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 593/1200] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:44:55 2022] GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:44:56.312660 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-384fdd8b-8d9d-4bcc-9378-f2877f63cb2f tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:44:56.313493 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-384fdd8b-8d9d-4bcc-9378-f2877f63cb2f tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: ab5cfe14-4eed-4104-b042-20724e4ba94f] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:44:56.322766 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-384fdd8b-8d9d-4bcc-9378-f2877f63cb2f tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:56.326976 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-384fdd8b-8d9d-4bcc-9378-f2877f63cb2f tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:56.328608 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-384fdd8b-8d9d-4bcc-9378-f2877f63cb2f tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:56.329330 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-384fdd8b-8d9d-4bcc-9378-f2877f63cb2f tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:56.508192 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-384fdd8b-8d9d-4bcc-9378-f2877f63cb2f tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:44:56.516293 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-384fdd8b-8d9d-4bcc-9378-f2877f63cb2f tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f" status: 200 len: 1682 microversion: 2.1 time: 0.208607 Jun 01 04:44:56.521603 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 608/1201] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:44:56 2022] GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f => generated 1682 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:44:57.533038 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-05949277-9f34-4f3a-8871-e017caa20a60 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:44:57.536182 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-05949277-9f34-4f3a-8871-e017caa20a60 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: ab5cfe14-4eed-4104-b042-20724e4ba94f] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:44:57.540298 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-05949277-9f34-4f3a-8871-e017caa20a60 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:57.540751 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-05949277-9f34-4f3a-8871-e017caa20a60 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:57.541529 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-05949277-9f34-4f3a-8871-e017caa20a60 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:57.542151 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-05949277-9f34-4f3a-8871-e017caa20a60 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:57.684014 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-05949277-9f34-4f3a-8871-e017caa20a60 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:44:57.693056 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-05949277-9f34-4f3a-8871-e017caa20a60 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f" status: 200 len: 1682 microversion: 2.1 time: 0.163981 Jun 01 04:44:57.702630 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 594/1202] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:44:57 2022] GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:44:58.019139 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-366308de-f57c-42f1-8116-3743166859ee req-c8b754f1-88ea-4032-aa6f-15305873d9f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab5cfe14-4eed-4104-b042-20724e4ba94f", "name": "network-vif-deleted", "tag": "7f07b0bb-99cc-422d-a3a7-e17715db910a"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:44:58.028251 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-366308de-f57c-42f1-8116-3743166859ee req-c8b754f1-88ea-4032-aa6f-15305873d9f1 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:58.028715 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-366308de-f57c-42f1-8116-3743166859ee req-c8b754f1-88ea-4032-aa6f-15305873d9f1 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:58.046992 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-366308de-f57c-42f1-8116-3743166859ee req-c8b754f1-88ea-4032-aa6f-15305873d9f1 service nova] Creating event network-vif-deleted:7f07b0bb-99cc-422d-a3a7-e17715db910a for instance ab5cfe14-4eed-4104-b042-20724e4ba94f on hv-cinder-66710 Jun 01 04:44:58.049448 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-366308de-f57c-42f1-8116-3743166859ee req-c8b754f1-88ea-4032-aa6f-15305873d9f1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034706 Jun 01 04:44:58.050479 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 609/1203] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:44:58.716215 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-dd58f2f6-dd18-43ba-a167-1a4ec06f9815 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:44:58.718862 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-dd58f2f6-dd18-43ba-a167-1a4ec06f9815 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: ab5cfe14-4eed-4104-b042-20724e4ba94f] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:44:58.729694 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-dd58f2f6-dd18-43ba-a167-1a4ec06f9815 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:58.730269 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-dd58f2f6-dd18-43ba-a167-1a4ec06f9815 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:58.731226 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-dd58f2f6-dd18-43ba-a167-1a4ec06f9815 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:58.731969 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-dd58f2f6-dd18-43ba-a167-1a4ec06f9815 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:58.790950 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-dd58f2f6-dd18-43ba-a167-1a4ec06f9815 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:58.791514 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-dd58f2f6-dd18-43ba-a167-1a4ec06f9815 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:58.792255 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.objects.instance [None req-dd58f2f6-dd18-43ba-a167-1a4ec06f9815 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lazy-loading 'fault' on Instance uuid ab5cfe14-4eed-4104-b042-20724e4ba94f {{(pid=118517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:44:58.840327 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-dd58f2f6-dd18-43ba-a167-1a4ec06f9815 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:44:58.852877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-dd58f2f6-dd18-43ba-a167-1a4ec06f9815 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f" status: 200 len: 1331 microversion: 2.1 time: 0.144285 Jun 01 04:44:58.854097 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 595/1204] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:44:58 2022] GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f => generated 1331 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:44:59.871394 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-3759b441-9f64-4b45-abcb-18194e6193f6 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:44:59.872290 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-3759b441-9f64-4b45-abcb-18194e6193f6 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: ab5cfe14-4eed-4104-b042-20724e4ba94f] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:44:59.878689 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3759b441-9f64-4b45-abcb-18194e6193f6 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:59.879069 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3759b441-9f64-4b45-abcb-18194e6193f6 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:59.880011 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3759b441-9f64-4b45-abcb-18194e6193f6 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:44:59.880467 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3759b441-9f64-4b45-abcb-18194e6193f6 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:44:59.895865 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.wsgi [None req-3759b441-9f64-4b45-abcb-18194e6193f6 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] HTTP exception thrown: Instance ab5cfe14-4eed-4104-b042-20724e4ba94f could not be found. Jun 01 04:44:59.897518 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-3759b441-9f64-4b45-abcb-18194e6193f6 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Request method failure captured: Jun 01 04:44:59.897518 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: request: GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f HTTP/1.1 Jun 01 04:44:59.897518 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept: application/json Jun 01 04:44:59.897518 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept-Encoding: identity Jun 01 04:44:59.897518 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Connection: close Jun 01 04:44:59.897518 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Length: 0 Jun 01 04:44:59.897518 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Type: application/json Jun 01 04:44:59.897518 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Host: 10.222.0.18 Jun 01 04:44:59.897518 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Openstack-System-Scope: None Jun 01 04:44:59.897518 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: User-Agent: python-urllib3/1.26.9 Jun 01 04:44:59.897518 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Auth-Token: gAAAAABilu106jtQ5FQFoI4uiqXA9VQRHJyx7H5fGGtMI-QLhZ9wzEW4QntKBbHMyg13vDMrRhGraMRm2tDoM-Qty4nj0NCDDE4r_xFFVOkMZvSyYWVAglaTnBtH6geTi9BY7b2EpB-efWXbewEEXtidDt5wGfiLJoigjqd8nO6N2RC-Av-UzW8 Jun 01 04:44:59.897518 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Id: None Jun 01 04:44:59.897518 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Name: None Jun 01 04:44:59.897518 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Identity-Status: Confirmed Jun 01 04:44:59.897518 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Is-Admin-Project: True Jun 01 04:44:59.897518 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Id: default Jun 01 04:44:59.897518 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Name: Default Jun 01 04:44:59.897518 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Id: 756cb4ed8d2345dcaae27638b257a480 Jun 01 04:44:59.897518 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Name: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:44:59.897518 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Role: reader,member Jun 01 04:44:59.897518 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Roles: reader,member Jun 01 04:44:59.900713 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:44:59.900713 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:44:59.900713 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Id: 756cb4ed8d2345dcaae27638b257a480 Jun 01 04:44:59.900713 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:44:59.900713 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User: tempest-AttachVolumeNegativeTest-373300167-project Jun 01 04:44:59.900713 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Id: default Jun 01 04:44:59.900713 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Name: Default Jun 01 04:44:59.900713 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Id: a17f39a1626d45299666f43be4ffc3ec Jun 01 04:44:59.900713 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Name: tempest-AttachVolumeNegativeTest-373300167-project Jun 01 04:44:59.900713 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: method: > Jun 01 04:44:59.900713 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: exception: Instance ab5cfe14-4eed-4104-b042-20724e4ba94f could not be found. Jun 01 04:44:59.900713 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: action_args: {'id': 'ab5cfe14-4eed-4104-b042-20724e4ba94f'} Jun 01 04:44:59.902355 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:44:59.902355 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:44:59.902355 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:44:59.902355 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:44:59.902355 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:44:59.902355 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:44:59.902355 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:44:59.902355 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:44:59.902355 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:44:59.902355 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:44:59.902355 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab5cfe14-4eed-4104-b042-20724e4ba94f could not be found. Jun 01 04:44:59.902355 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:44:59.902355 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:44:59.902355 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:44:59.902355 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:44:59.902355 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:44:59.902355 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:44:59.902355 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:44:59.902355 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:44:59.902355 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:44:59.906280 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:44:59.906280 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 01 04:44:59.906280 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 01 04:44:59.906280 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:44:59.906280 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:44:59.906280 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:44:59.906280 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:44:59.906280 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab5cfe14-4eed-4104-b042-20724e4ba94f could not be found. Jun 01 04:44:59.906280 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:44:59.906280 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:44:59.906280 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:44:59.906280 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:44:59.906280 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:44:59.906280 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:44:59.906280 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:44:59.906280 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:44:59.906280 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab5cfe14-4eed-4104-b042-20724e4ba94f could not be found. Jun 01 04:44:59.906280 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:44:59.908015 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-3759b441-9f64-4b45-abcb-18194e6193f6 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Returning 404 to user: Instance ab5cfe14-4eed-4104-b042-20724e4ba94f could not be found. {{(pid=118516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:44:59.908015 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-3759b441-9f64-4b45-abcb-18194e6193f6 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f" status: 404 len: 111 microversion: 2.1 time: 0.032220 Jun 01 04:44:59.908015 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 610/1205] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:44:59 2022] GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 01 04:44:59.908475 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-b8da0f9b-d70e-436e-9942-4dd08396c7bc tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '.version_select at 0x7ff32ab0a280>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:45:00.016479 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-b8da0f9b-d70e-436e-9942-4dd08396c7bc tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1587629131" status: 202 len: 0 microversion: 2.1 time: 0.112168 Jun 01 04:45:00.017069 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 596/1206] 10.222.0.18 () {58 vars in 1220 bytes} [Wed Jun 1 04:44:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1587629131 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 01 04:45:00.822618 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-1454eef1-89e0-40fb-b7fa-5978eeae5127 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Action: 'create', calling method: .version_select at 0x7ff32594b040>, body: {"keypair": {"name": "tempest-keypair-184084567", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOYCoGSQ4/pKgtZc7+oGG8yzUHOkLorWuZ4nrzkyd+6shl7aqSPyK63PsjKxXBZAiiE+nu7N3aRNw7NJ6e5WfZfUzBQXJAXF+8q5j/WT5wdu7jjTlvSXx1cqWCSWwlTbA=="}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:45:00.837299 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-1454eef1-89e0-40fb-b7fa-5978eeae5127 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Getting quotas for project 756cb4ed8d2345dcaae27638b257a480. Resources: {'key_pairs'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:45:00.841458 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.quota [None req-1454eef1-89e0-40fb-b7fa-5978eeae5127 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Getting quotas for user a17f39a1626d45299666f43be4ffc3ec and project 756cb4ed8d2345dcaae27638b257a480. Resources: {'key_pairs'} {{(pid=118516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:45:00.965204 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-1454eef1-89e0-40fb-b7fa-5978eeae5127 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.146361 Jun 01 04:45:00.966105 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 611/1207] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jun 1 04:45:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 01 04:45:03.502258 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-e0f80642-806c-4173-851b-a35fd33b1ea7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1626770426", "imageRef": "14321baa-3ac5-4c53-8054-4945abce5b2d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8715975b-1e98-4a30-82e5-baf5c981e463"}], "security_groups": [{"name": "tempest-securitygroup--696037006"}], "key_name": "tempest-keypair-184084567", "user_data": "}} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:45:03.603859 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.network.neutron [None req-e0f80642-806c-4173-851b-a35fd33b1ea7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] validate_networks() for [('8715975b-1e98-4a30-82e5-baf5c981e463', None, None, None, None, None)] {{(pid=118517) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 01 04:45:03.969409 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-e0f80642-806c-4173-851b-a35fd33b1ea7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Flavor limits 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 01 04:45:03.969876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-e0f80642-806c-4173-851b-a35fd33b1ea7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Image limits 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 01 04:45:03.970367 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-e0f80642-806c-4173-851b-a35fd33b1ea7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Flavor pref 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 01 04:45:03.970770 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-e0f80642-806c-4173-851b-a35fd33b1ea7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Image pref 0:0:0 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 01 04:45:03.971176 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.virt.hardware [None req-e0f80642-806c-4173-851b-a35fd33b1ea7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 01 04:45:03.980355 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e0f80642-806c-4173-851b-a35fd33b1ea7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:45:03.980794 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e0f80642-806c-4173-851b-a35fd33b1ea7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:45:03.981579 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e0f80642-806c-4173-851b-a35fd33b1ea7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:45:03.982006 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-e0f80642-806c-4173-851b-a35fd33b1ea7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:45:03.998353 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.quota [None req-e0f80642-806c-4173-851b-a35fd33b1ea7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Getting quotas for project 756cb4ed8d2345dcaae27638b257a480. Resources: {'ram', 'instances', 'cores'} {{(pid=118517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 01 04:45:04.003076 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.quota [None req-e0f80642-806c-4173-851b-a35fd33b1ea7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Getting quotas for user a17f39a1626d45299666f43be4ffc3ec and project 756cb4ed8d2345dcaae27638b257a480. Resources: {'ram', 'instances', 'cores'} {{(pid=118517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 01 04:45:04.014172 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-e0f80642-806c-4173-851b-a35fd33b1ea7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Going to run 1 instances... {{(pid=118517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 01 04:45:04.017028 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-e0f80642-806c-4173-851b-a35fd33b1ea7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 2fc92e48-a662-417d-8118-f9e3d841406b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14321baa-3ac5-4c53-8054-4945abce5b2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 01 04:45:04.117073 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-e0f80642-806c-4173-851b-a35fd33b1ea7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.619101 Jun 01 04:45:04.117714 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 597/1208] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jun 1 04:45:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 01 04:45:04.128963 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-88929fc3-df8a-4b25-ba57-f828f2eaba04 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:45:04.129591 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-88929fc3-df8a-4b25-ba57-f828f2eaba04 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 2fc92e48-a662-417d-8118-f9e3d841406b] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:45:04.192796 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-88929fc3-df8a-4b25-ba57-f828f2eaba04 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:45:04.199710 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-88929fc3-df8a-4b25-ba57-f828f2eaba04 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b" status: 200 len: 1241 microversion: 2.1 time: 0.075856 Jun 01 04:45:04.200275 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 612/1209] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:45:04 2022] GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 01 04:45:05.217116 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-4063ccad-c100-4b20-85a0-00395afd77e0 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:45:05.217876 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-4063ccad-c100-4b20-85a0-00395afd77e0 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 2fc92e48-a662-417d-8118-f9e3d841406b] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:45:05.224479 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4063ccad-c100-4b20-85a0-00395afd77e0 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:45:05.234009 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4063ccad-c100-4b20-85a0-00395afd77e0 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:45:05.234009 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4063ccad-c100-4b20-85a0-00395afd77e0 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:45:05.234009 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-4063ccad-c100-4b20-85a0-00395afd77e0 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:45:05.298859 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-4063ccad-c100-4b20-85a0-00395afd77e0 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:45:05.306915 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-4063ccad-c100-4b20-85a0-00395afd77e0 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b" status: 200 len: 1245 microversion: 2.1 time: 0.094200 Jun 01 04:45:05.307532 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 598/1210] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:45:05 2022] GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b => generated 1245 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:45:06.324865 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-78021009-8072-49af-9060-c814abcc40c4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:45:06.325483 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-78021009-8072-49af-9060-c814abcc40c4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 2fc92e48-a662-417d-8118-f9e3d841406b] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:45:06.332224 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-78021009-8072-49af-9060-c814abcc40c4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:45:06.332706 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-78021009-8072-49af-9060-c814abcc40c4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:45:06.333464 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-78021009-8072-49af-9060-c814abcc40c4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:45:06.333910 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-78021009-8072-49af-9060-c814abcc40c4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:45:06.415674 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-78021009-8072-49af-9060-c814abcc40c4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:45:06.423159 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-78021009-8072-49af-9060-c814abcc40c4 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b" status: 200 len: 1311 microversion: 2.1 time: 0.102394 Jun 01 04:45:06.423767 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 613/1211] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:45:06 2022] GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:45:07.440366 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-6f8dd3a5-3f37-4bbe-86b1-546de801afaa tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:45:07.441042 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-6f8dd3a5-3f37-4bbe-86b1-546de801afaa tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 2fc92e48-a662-417d-8118-f9e3d841406b] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:45:07.447654 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6f8dd3a5-3f37-4bbe-86b1-546de801afaa tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:45:07.448119 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6f8dd3a5-3f37-4bbe-86b1-546de801afaa tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:45:07.448860 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6f8dd3a5-3f37-4bbe-86b1-546de801afaa tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:45:07.449289 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6f8dd3a5-3f37-4bbe-86b1-546de801afaa tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:45:07.578266 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-6f8dd3a5-3f37-4bbe-86b1-546de801afaa tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:45:07.585823 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-6f8dd3a5-3f37-4bbe-86b1-546de801afaa tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b" status: 200 len: 1366 microversion: 2.1 time: 0.149932 Jun 01 04:45:07.596058 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 599/1212] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:45:07 2022] GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:45:07.926662 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-7f0b3442-5eb6-4310-a873-73d4aca7dfcc req-c0b02be5-5518-4ee6-865b-691681715e41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fc92e48-a662-417d-8118-f9e3d841406b", "tag": "b64f82dd-614f-4f56-87a9-5588b3859899"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:45:07.935256 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-7f0b3442-5eb6-4310-a873-73d4aca7dfcc req-c0b02be5-5518-4ee6-865b-691681715e41 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:45:07.935965 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-7f0b3442-5eb6-4310-a873-73d4aca7dfcc req-c0b02be5-5518-4ee6-865b-691681715e41 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:45:07.947280 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-7f0b3442-5eb6-4310-a873-73d4aca7dfcc req-c0b02be5-5518-4ee6-865b-691681715e41 service nova] Creating event network-changed:b64f82dd-614f-4f56-87a9-5588b3859899 for instance 2fc92e48-a662-417d-8118-f9e3d841406b on hv-cinder-66710 Jun 01 04:45:07.952278 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-7f0b3442-5eb6-4310-a873-73d4aca7dfcc req-c0b02be5-5518-4ee6-865b-691681715e41 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029249 Jun 01 04:45:07.952878 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 614/1213] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:45:08.603462 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-d3a2fede-2b91-45b0-82af-c529bd746155 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:45:08.604071 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-d3a2fede-2b91-45b0-82af-c529bd746155 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 2fc92e48-a662-417d-8118-f9e3d841406b] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:45:08.610579 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d3a2fede-2b91-45b0-82af-c529bd746155 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:45:08.611023 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d3a2fede-2b91-45b0-82af-c529bd746155 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:45:08.611807 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d3a2fede-2b91-45b0-82af-c529bd746155 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:45:08.612240 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d3a2fede-2b91-45b0-82af-c529bd746155 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:45:08.742246 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-d3a2fede-2b91-45b0-82af-c529bd746155 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:45:08.750313 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-d3a2fede-2b91-45b0-82af-c529bd746155 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b" status: 200 len: 1366 microversion: 2.1 time: 0.151015 Jun 01 04:45:08.750877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 600/1214] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:45:08 2022] GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:45:09.768915 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-c0a53d3b-bd0d-49e8-bbaa-d8d718bd10c5 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:45:09.769620 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-c0a53d3b-bd0d-49e8-bbaa-d8d718bd10c5 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 2fc92e48-a662-417d-8118-f9e3d841406b] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:45:09.776148 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c0a53d3b-bd0d-49e8-bbaa-d8d718bd10c5 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:45:09.776603 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c0a53d3b-bd0d-49e8-bbaa-d8d718bd10c5 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:45:09.777400 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c0a53d3b-bd0d-49e8-bbaa-d8d718bd10c5 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:45:09.777837 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c0a53d3b-bd0d-49e8-bbaa-d8d718bd10c5 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:45:09.904478 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-c0a53d3b-bd0d-49e8-bbaa-d8d718bd10c5 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:45:09.907439 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:45:09.913258 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-c0a53d3b-bd0d-49e8-bbaa-d8d718bd10c5 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b" status: 200 len: 1366 microversion: 2.1 time: 0.149720 Jun 01 04:45:09.913820 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 615/1215] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:45:09 2022] GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:45:10.929958 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-d45c0952-8307-4ea3-a99c-540594c0b8f6 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:45:10.930498 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-d45c0952-8307-4ea3-a99c-540594c0b8f6 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 2fc92e48-a662-417d-8118-f9e3d841406b] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:45:10.937075 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d45c0952-8307-4ea3-a99c-540594c0b8f6 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:45:10.937519 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d45c0952-8307-4ea3-a99c-540594c0b8f6 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:45:10.938275 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d45c0952-8307-4ea3-a99c-540594c0b8f6 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:45:10.938702 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-d45c0952-8307-4ea3-a99c-540594c0b8f6 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:45:11.067791 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-d45c0952-8307-4ea3-a99c-540594c0b8f6 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:45:11.075203 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-d45c0952-8307-4ea3-a99c-540594c0b8f6 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b" status: 200 len: 1366 microversion: 2.1 time: 0.149128 Jun 01 04:45:11.075793 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 601/1216] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:45:10 2022] GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:45:12.092428 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-97523db2-180a-400e-99b8-e294da33a3d8 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:45:12.093037 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-97523db2-180a-400e-99b8-e294da33a3d8 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 2fc92e48-a662-417d-8118-f9e3d841406b] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:45:12.095332 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:45:12.101012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-97523db2-180a-400e-99b8-e294da33a3d8 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:45:12.101455 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-97523db2-180a-400e-99b8-e294da33a3d8 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:45:12.102212 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-97523db2-180a-400e-99b8-e294da33a3d8 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:45:12.102640 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-97523db2-180a-400e-99b8-e294da33a3d8 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:45:12.232157 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-97523db2-180a-400e-99b8-e294da33a3d8 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:45:12.240119 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-97523db2-180a-400e-99b8-e294da33a3d8 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b" status: 200 len: 1366 microversion: 2.1 time: 0.151883 Jun 01 04:45:12.240724 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 616/1217] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:45:12 2022] GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:45:13.257539 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-6f8cbb20-0516-40e1-b68b-fdff209461b3 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:45:13.258145 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-6f8cbb20-0516-40e1-b68b-fdff209461b3 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 2fc92e48-a662-417d-8118-f9e3d841406b] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:45:13.260556 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:45:13.266039 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6f8cbb20-0516-40e1-b68b-fdff209461b3 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:45:13.268287 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6f8cbb20-0516-40e1-b68b-fdff209461b3 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:45:13.268287 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6f8cbb20-0516-40e1-b68b-fdff209461b3 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:45:13.268287 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-6f8cbb20-0516-40e1-b68b-fdff209461b3 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:45:13.274862 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:45:13.403259 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-6f8cbb20-0516-40e1-b68b-fdff209461b3 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:45:13.411769 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-6f8cbb20-0516-40e1-b68b-fdff209461b3 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b" status: 200 len: 1366 microversion: 2.1 time: 0.157951 Jun 01 04:45:13.417780 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 602/1218] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:45:13 2022] GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:45:14.428661 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-81456065-6888-4a21-b3a0-32a191ceaecf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:45:14.429272 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-81456065-6888-4a21-b3a0-32a191ceaecf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 2fc92e48-a662-417d-8118-f9e3d841406b] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:45:14.431954 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell0:SELECT=6 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:45:14.436704 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-81456065-6888-4a21-b3a0-32a191ceaecf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:45:14.438721 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-81456065-6888-4a21-b3a0-32a191ceaecf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:45:14.438721 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-81456065-6888-4a21-b3a0-32a191ceaecf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:45:14.438721 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-81456065-6888-4a21-b3a0-32a191ceaecf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:45:14.571579 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-81456065-6888-4a21-b3a0-32a191ceaecf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:45:14.579693 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-81456065-6888-4a21-b3a0-32a191ceaecf tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b" status: 200 len: 1366 microversion: 2.1 time: 0.154799 Jun 01 04:45:14.580269 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 617/1219] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:45:14 2022] GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:45:15.370257 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell0:SELECT=2 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:45:15.370971 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell0:SELECT=6 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:45:15.489609 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [req-bb7fce36-2afa-462d-9f54-d201ad443cdc req-4a16fac4-acc5-41be-933c-2878a99b26c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fc92e48-a662-417d-8118-f9e3d841406b", "name": "network-vif-plugged", "status": "completed", "tag": "b64f82dd-614f-4f56-87a9-5588b3859899"}]} {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:45:15.497422 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-bb7fce36-2afa-462d-9f54-d201ad443cdc req-4a16fac4-acc5-41be-933c-2878a99b26c6 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:45:15.497859 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [req-bb7fce36-2afa-462d-9f54-d201ad443cdc req-4a16fac4-acc5-41be-933c-2878a99b26c6 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:45:15.510397 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.compute.server_external_events [req-bb7fce36-2afa-462d-9f54-d201ad443cdc req-4a16fac4-acc5-41be-933c-2878a99b26c6 service nova] Creating event network-vif-plugged:b64f82dd-614f-4f56-87a9-5588b3859899 for instance 2fc92e48-a662-417d-8118-f9e3d841406b on hv-cinder-66710 Jun 01 04:45:15.516125 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [req-bb7fce36-2afa-462d-9f54-d201ad443cdc req-4a16fac4-acc5-41be-933c-2878a99b26c6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150398 Jun 01 04:45:15.516302 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 603/1220] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:45:15.596976 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-93f52bd3-c096-413d-85be-c5d0668cddc0 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:45:15.597578 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-93f52bd3-c096-413d-85be-c5d0668cddc0 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 2fc92e48-a662-417d-8118-f9e3d841406b] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:45:15.604627 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-93f52bd3-c096-413d-85be-c5d0668cddc0 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:45:15.605083 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-93f52bd3-c096-413d-85be-c5d0668cddc0 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:45:15.605854 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-93f52bd3-c096-413d-85be-c5d0668cddc0 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:45:15.606294 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-93f52bd3-c096-413d-85be-c5d0668cddc0 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:45:15.735482 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-93f52bd3-c096-413d-85be-c5d0668cddc0 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:45:15.743416 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-93f52bd3-c096-413d-85be-c5d0668cddc0 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b" status: 200 len: 1366 microversion: 2.1 time: 0.150814 Jun 01 04:45:15.743980 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 618/1221] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:45:15 2022] GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:45:16.760755 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-bdbbeed2-4619-429b-8ade-9c3239c7c6bb tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:45:16.761455 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-bdbbeed2-4619-429b-8ade-9c3239c7c6bb tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 2fc92e48-a662-417d-8118-f9e3d841406b] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:45:16.768573 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bdbbeed2-4619-429b-8ade-9c3239c7c6bb tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:45:16.769028 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bdbbeed2-4619-429b-8ade-9c3239c7c6bb tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:45:16.769797 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bdbbeed2-4619-429b-8ade-9c3239c7c6bb tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:45:16.770237 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bdbbeed2-4619-429b-8ade-9c3239c7c6bb tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:45:16.902877 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-bdbbeed2-4619-429b-8ade-9c3239c7c6bb tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:45:16.910785 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-bdbbeed2-4619-429b-8ade-9c3239c7c6bb tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b" status: 200 len: 1366 microversion: 2.1 time: 0.154465 Jun 01 04:45:16.911381 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 604/1222] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:45:16 2022] GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:45:17.927740 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-3232a964-eeff-491e-9d11-5ba6d9ef88dd tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:45:17.928276 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-3232a964-eeff-491e-9d11-5ba6d9ef88dd tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 2fc92e48-a662-417d-8118-f9e3d841406b] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:45:17.934927 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3232a964-eeff-491e-9d11-5ba6d9ef88dd tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:45:17.935559 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3232a964-eeff-491e-9d11-5ba6d9ef88dd tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:45:17.936316 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3232a964-eeff-491e-9d11-5ba6d9ef88dd tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:45:17.936754 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-3232a964-eeff-491e-9d11-5ba6d9ef88dd tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:45:18.062986 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-3232a964-eeff-491e-9d11-5ba6d9ef88dd tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:45:18.070404 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-3232a964-eeff-491e-9d11-5ba6d9ef88dd tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b" status: 200 len: 1556 microversion: 2.1 time: 0.146605 Jun 01 04:45:18.070971 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 619/1223] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:45:17 2022] GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b => generated 1556 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:45:18.086928 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-9518ca98-34e7-468d-8999-8cae8f6b4ee3 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:45:18.087471 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-9518ca98-34e7-468d-8999-8cae8f6b4ee3 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 2fc92e48-a662-417d-8118-f9e3d841406b] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:45:18.094468 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9518ca98-34e7-468d-8999-8cae8f6b4ee3 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:45:18.094918 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9518ca98-34e7-468d-8999-8cae8f6b4ee3 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:45:18.095716 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9518ca98-34e7-468d-8999-8cae8f6b4ee3 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:45:18.096151 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-9518ca98-34e7-468d-8999-8cae8f6b4ee3 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:45:18.172462 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-9518ca98-34e7-468d-8999-8cae8f6b4ee3 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089243 Jun 01 04:45:18.173054 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 605/1224] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Jun 1 04:45:18 2022] GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:45:19.191975 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-f4a7de26-193b-4344-965d-a0f822cc34ff req-449f61e4-a2ef-4b00-8067-a37fe93250e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fc92e48-a662-417d-8118-f9e3d841406b", "tag": "b64f82dd-614f-4f56-87a9-5588b3859899"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:45:19.199971 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-f4a7de26-193b-4344-965d-a0f822cc34ff req-449f61e4-a2ef-4b00-8067-a37fe93250e2 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:45:19.200406 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-f4a7de26-193b-4344-965d-a0f822cc34ff req-449f61e4-a2ef-4b00-8067-a37fe93250e2 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:45:19.213455 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-f4a7de26-193b-4344-965d-a0f822cc34ff req-449f61e4-a2ef-4b00-8067-a37fe93250e2 service nova] Creating event network-changed:b64f82dd-614f-4f56-87a9-5588b3859899 for instance 2fc92e48-a662-417d-8118-f9e3d841406b on hv-cinder-66710 Jun 01 04:45:19.219149 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-f4a7de26-193b-4344-965d-a0f822cc34ff req-449f61e4-a2ef-4b00-8067-a37fe93250e2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090284 Jun 01 04:45:19.219800 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 620/1225] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:45:53.094190 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 01 04:45:53.094923 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Wed Jun 1 04:45:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 01 04:46:31.902782 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_api:SELECT=7 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:46:31.903473 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG dbcounter [-] [118517] Writing DB stats nova_cell1:SELECT=17 {{(pid=118517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:46:31.908277 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-14c8a09a-b3da-4a38-ad32-75651b5fab47 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:46:31.908763 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-14c8a09a-b3da-4a38-ad32-75651b5fab47 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 2fc92e48-a662-417d-8118-f9e3d841406b] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:46:31.914789 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-14c8a09a-b3da-4a38-ad32-75651b5fab47 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:31.920694 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-14c8a09a-b3da-4a38-ad32-75651b5fab47 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:31.920694 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-14c8a09a-b3da-4a38-ad32-75651b5fab47 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:31.920694 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-14c8a09a-b3da-4a38-ad32-75651b5fab47 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:31.939872 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-14c8a09a-b3da-4a38-ad32-75651b5fab47 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b/ips" status: 200 len: 150 microversion: 2.1 time: 0.039281 Jun 01 04:46:31.940454 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 606/1226] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jun 1 04:46:31 2022] GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:46:34.516935 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_api:SELECT=9 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:46:34.517667 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG dbcounter [-] [118516] Writing DB stats nova_cell1:SELECT=27 {{(pid=118516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:46:34.522367 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-c95cd390-1351-4f3e-9eed-b9e1daa343fe tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "afc6273e-80c4-4d3e-add9-15d86330cd95"}} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:46:34.523531 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-c95cd390-1351-4f3e-9eed-b9e1daa343fe tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 2fc92e48-a662-417d-8118-f9e3d841406b] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:46:34.530214 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c95cd390-1351-4f3e-9eed-b9e1daa343fe tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:34.530666 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c95cd390-1351-4f3e-9eed-b9e1daa343fe tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:34.531497 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c95cd390-1351-4f3e-9eed-b9e1daa343fe tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:34.531940 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-c95cd390-1351-4f3e-9eed-b9e1daa343fe tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:35.313601 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-c95cd390-1351-4f3e-9eed-b9e1daa343fe tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "POST /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.798389 Jun 01 04:46:35.314273 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 621/1227] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jun 1 04:46:34 2022] POST /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b/os-volume_attachments => generated 194 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:46:42.899791 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-bbe79253-99a1-4154-ae0f-5e3a297e945e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:46:42.900378 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-bbe79253-99a1-4154-ae0f-5e3a297e945e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 2fc92e48-a662-417d-8118-f9e3d841406b] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:46:42.907673 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bbe79253-99a1-4154-ae0f-5e3a297e945e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:42.908115 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bbe79253-99a1-4154-ae0f-5e3a297e945e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:42.908866 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bbe79253-99a1-4154-ae0f-5e3a297e945e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:42.909296 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-bbe79253-99a1-4154-ae0f-5e3a297e945e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:42.990898 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.objects.instance [None req-bbe79253-99a1-4154-ae0f-5e3a297e945e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lazy-loading 'services' on Instance uuid 2fc92e48-a662-417d-8118-f9e3d841406b {{(pid=118517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:46:43.182595 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-bbe79253-99a1-4154-ae0f-5e3a297e945e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b/os-volume_attachments/afc6273e-80c4-4d3e-add9-15d86330cd95" status: 202 len: 0 microversion: 2.1 time: 0.286956 Jun 01 04:46:43.183149 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 607/1228] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jun 1 04:46:42 2022] DELETE /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b/os-volume_attachments/afc6273e-80c4-4d3e-add9-15d86330cd95 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 01 04:46:43.192731 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-bc9c4633-02b5-4a1d-ad16-f5a552189309 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:46:43.193899 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-bc9c4633-02b5-4a1d-ad16-f5a552189309 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 2fc92e48-a662-417d-8118-f9e3d841406b] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:46:43.200158 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bc9c4633-02b5-4a1d-ad16-f5a552189309 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:43.201388 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bc9c4633-02b5-4a1d-ad16-f5a552189309 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:43.201876 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bc9c4633-02b5-4a1d-ad16-f5a552189309 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:43.202313 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-bc9c4633-02b5-4a1d-ad16-f5a552189309 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:43.231740 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-bc9c4633-02b5-4a1d-ad16-f5a552189309 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043799 Jun 01 04:46:43.232293 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 622/1229] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 1 04:46:43 2022] GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:46:44.243621 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-46bf3b80-083d-40de-a455-bb6fcb3b9d0f tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:46:44.244677 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-46bf3b80-083d-40de-a455-bb6fcb3b9d0f tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 2fc92e48-a662-417d-8118-f9e3d841406b] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:46:44.254234 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-46bf3b80-083d-40de-a455-bb6fcb3b9d0f tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:44.254699 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-46bf3b80-083d-40de-a455-bb6fcb3b9d0f tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:44.255544 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-46bf3b80-083d-40de-a455-bb6fcb3b9d0f tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:44.255986 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-46bf3b80-083d-40de-a455-bb6fcb3b9d0f tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:44.286758 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-46bf3b80-083d-40de-a455-bb6fcb3b9d0f tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047868 Jun 01 04:46:44.287423 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 608/1230] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jun 1 04:46:44 2022] GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 01 04:46:44.346026 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-88a448e0-8b89-4aa6-92ea-9f55c65d97a2 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:46:44.348557 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-88a448e0-8b89-4aa6-92ea-9f55c65d97a2 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 2fc92e48-a662-417d-8118-f9e3d841406b] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:46:44.353212 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-88a448e0-8b89-4aa6-92ea-9f55c65d97a2 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:44.353918 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-88a448e0-8b89-4aa6-92ea-9f55c65d97a2 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:44.354421 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-88a448e0-8b89-4aa6-92ea-9f55c65d97a2 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:44.355111 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-88a448e0-8b89-4aa6-92ea-9f55c65d97a2 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:44.380012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-88a448e0-8b89-4aa6-92ea-9f55c65d97a2 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 2fc92e48-a662-417d-8118-f9e3d841406b] Going to try to terminate instance {{(pid=118516) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 01 04:46:44.702496 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-88a448e0-8b89-4aa6-92ea-9f55c65d97a2 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b" status: 204 len: 0 microversion: 2.1 time: 0.361610 Jun 01 04:46:44.703084 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 623/1231] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 1 04:46:44 2022] DELETE /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 01 04:46:44.711149 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a4edb475-34da-4a3f-b7be-045fa6066ec2 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:46:44.711808 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-a4edb475-34da-4a3f-b7be-045fa6066ec2 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 2fc92e48-a662-417d-8118-f9e3d841406b] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:46:44.718480 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a4edb475-34da-4a3f-b7be-045fa6066ec2 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:44.718931 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a4edb475-34da-4a3f-b7be-045fa6066ec2 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:44.719730 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a4edb475-34da-4a3f-b7be-045fa6066ec2 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:44.720169 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a4edb475-34da-4a3f-b7be-045fa6066ec2 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:44.852377 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-a4edb475-34da-4a3f-b7be-045fa6066ec2 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:46:44.860099 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-a4edb475-34da-4a3f-b7be-045fa6066ec2 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b" status: 200 len: 1681 microversion: 2.1 time: 0.152821 Jun 01 04:46:44.860674 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 609/1232] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:46:44 2022] GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:46:45.878320 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-83892b42-a541-4ad6-848e-c0a3bc3d73ce tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:46:45.878978 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-83892b42-a541-4ad6-848e-c0a3bc3d73ce tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 2fc92e48-a662-417d-8118-f9e3d841406b] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:46:45.885560 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-83892b42-a541-4ad6-848e-c0a3bc3d73ce tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:45.886021 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-83892b42-a541-4ad6-848e-c0a3bc3d73ce tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:45.886787 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-83892b42-a541-4ad6-848e-c0a3bc3d73ce tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:45.887233 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-83892b42-a541-4ad6-848e-c0a3bc3d73ce tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:46.019935 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.policy [None req-83892b42-a541-4ad6-848e-c0a3bc3d73ce tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118516) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:46:46.027377 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-83892b42-a541-4ad6-848e-c0a3bc3d73ce tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b" status: 200 len: 1681 microversion: 2.1 time: 0.153350 Jun 01 04:46:46.027940 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 624/1233] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:46:45 2022] GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:46:47.044350 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-8db95814-4960-4f11-b80f-0012300eba94 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:46:47.045504 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-8db95814-4960-4f11-b80f-0012300eba94 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 2fc92e48-a662-417d-8118-f9e3d841406b] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:46:47.052013 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8db95814-4960-4f11-b80f-0012300eba94 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:47.052588 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8db95814-4960-4f11-b80f-0012300eba94 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:47.053360 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8db95814-4960-4f11-b80f-0012300eba94 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:47.053794 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8db95814-4960-4f11-b80f-0012300eba94 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:47.192220 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-8db95814-4960-4f11-b80f-0012300eba94 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:46:47.200219 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-8db95814-4960-4f11-b80f-0012300eba94 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b" status: 200 len: 1681 microversion: 2.1 time: 0.159531 Jun 01 04:46:47.200972 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 610/1234] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:46:47 2022] GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:46:47.473195 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [req-3330a47f-f051-4e79-8119-f61ea4ac6e02 req-d0b5ec31-f2f2-4323-919e-c15731d66e71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fc92e48-a662-417d-8118-f9e3d841406b", "name": "network-vif-deleted", "tag": "b64f82dd-614f-4f56-87a9-5588b3859899"}]} {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 01 04:46:47.481901 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-3330a47f-f051-4e79-8119-f61ea4ac6e02 req-d0b5ec31-f2f2-4323-919e-c15731d66e71 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:47.482929 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [req-3330a47f-f051-4e79-8119-f61ea4ac6e02 req-d0b5ec31-f2f2-4323-919e-c15731d66e71 service nova] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:47.494534 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.compute.server_external_events [req-3330a47f-f051-4e79-8119-f61ea4ac6e02 req-d0b5ec31-f2f2-4323-919e-c15731d66e71 service nova] Creating event network-vif-deleted:b64f82dd-614f-4f56-87a9-5588b3859899 for instance 2fc92e48-a662-417d-8118-f9e3d841406b on hv-cinder-66710 Jun 01 04:46:47.499825 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [req-3330a47f-f051-4e79-8119-f61ea4ac6e02 req-d0b5ec31-f2f2-4323-919e-c15731d66e71 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030663 Jun 01 04:46:47.500876 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 625/1235] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jun 1 04:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 01 04:46:48.217805 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-8e130f3a-e507-4470-b07a-4156cc889f48 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:46:48.218425 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-8e130f3a-e507-4470-b07a-4156cc889f48 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 2fc92e48-a662-417d-8118-f9e3d841406b] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:46:48.225588 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8e130f3a-e507-4470-b07a-4156cc889f48 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:48.226041 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8e130f3a-e507-4470-b07a-4156cc889f48 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:48.226818 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8e130f3a-e507-4470-b07a-4156cc889f48 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:48.227260 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8e130f3a-e507-4470-b07a-4156cc889f48 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:48.260172 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8e130f3a-e507-4470-b07a-4156cc889f48 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:48.260625 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-8e130f3a-e507-4470-b07a-4156cc889f48 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:48.261085 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.objects.instance [None req-8e130f3a-e507-4470-b07a-4156cc889f48 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lazy-loading 'fault' on Instance uuid 2fc92e48-a662-417d-8118-f9e3d841406b {{(pid=118517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 01 04:46:48.303521 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.policy [None req-8e130f3a-e507-4470-b07a-4156cc889f48 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17f39a1626d45299666f43be4ffc3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756cb4ed8d2345dcaae27638b257a480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118517) authorize /opt/stack/nova/nova/policy.py:199}} Jun 01 04:46:48.311279 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-8e130f3a-e507-4470-b07a-4156cc889f48 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b" status: 200 len: 1331 microversion: 2.1 time: 0.097842 Jun 01 04:46:48.318456 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 611/1236] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:46:48 2022] GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 01 04:46:49.336245 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-7c328cec-3b67-47df-8f57-2a319867545c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:46:49.336940 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-7c328cec-3b67-47df-8f57-2a319867545c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 2fc92e48-a662-417d-8118-f9e3d841406b] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:46:49.343377 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7c328cec-3b67-47df-8f57-2a319867545c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:49.343828 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7c328cec-3b67-47df-8f57-2a319867545c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:49.344579 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7c328cec-3b67-47df-8f57-2a319867545c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:49.345404 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-7c328cec-3b67-47df-8f57-2a319867545c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:49.358978 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.wsgi [None req-7c328cec-3b67-47df-8f57-2a319867545c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] HTTP exception thrown: Instance 2fc92e48-a662-417d-8118-f9e3d841406b could not be found. Jun 01 04:46:49.360615 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-7c328cec-3b67-47df-8f57-2a319867545c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Request method failure captured: Jun 01 04:46:49.360615 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: request: GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b HTTP/1.1 Jun 01 04:46:49.360615 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept: application/json Jun 01 04:46:49.360615 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept-Encoding: identity Jun 01 04:46:49.360615 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Connection: close Jun 01 04:46:49.360615 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Length: 0 Jun 01 04:46:49.360615 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Type: application/json Jun 01 04:46:49.360615 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Host: 10.222.0.18 Jun 01 04:46:49.360615 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Openstack-System-Scope: None Jun 01 04:46:49.360615 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: User-Agent: python-urllib3/1.26.9 Jun 01 04:46:49.360615 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Auth-Token: gAAAAABilu106jtQ5FQFoI4uiqXA9VQRHJyx7H5fGGtMI-QLhZ9wzEW4QntKBbHMyg13vDMrRhGraMRm2tDoM-Qty4nj0NCDDE4r_xFFVOkMZvSyYWVAglaTnBtH6geTi9BY7b2EpB-efWXbewEEXtidDt5wGfiLJoigjqd8nO6N2RC-Av-UzW8 Jun 01 04:46:49.360615 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Id: None Jun 01 04:46:49.360615 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Name: None Jun 01 04:46:49.360615 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Identity-Status: Confirmed Jun 01 04:46:49.360615 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Is-Admin-Project: True Jun 01 04:46:49.360615 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Id: default Jun 01 04:46:49.360615 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Name: Default Jun 01 04:46:49.360615 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Id: 756cb4ed8d2345dcaae27638b257a480 Jun 01 04:46:49.360615 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Name: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:46:49.360615 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Role: reader,member Jun 01 04:46:49.360615 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Roles: reader,member Jun 01 04:46:49.362404 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:46:49.362404 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:46:49.362404 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Id: 756cb4ed8d2345dcaae27638b257a480 Jun 01 04:46:49.362404 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:46:49.362404 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User: tempest-AttachVolumeNegativeTest-373300167-project Jun 01 04:46:49.362404 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Id: default Jun 01 04:46:49.362404 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Name: Default Jun 01 04:46:49.362404 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Id: a17f39a1626d45299666f43be4ffc3ec Jun 01 04:46:49.362404 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Name: tempest-AttachVolumeNegativeTest-373300167-project Jun 01 04:46:49.362404 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: method: > Jun 01 04:46:49.362404 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: exception: Instance 2fc92e48-a662-417d-8118-f9e3d841406b could not be found. Jun 01 04:46:49.362404 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: action_args: {'id': '2fc92e48-a662-417d-8118-f9e3d841406b'} Jun 01 04:46:49.363374 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:46:49.363374 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:46:49.363374 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:46:49.363374 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:46:49.363374 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:46:49.363374 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:46:49.363374 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:46:49.363374 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:46:49.363374 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:46:49.363374 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:46:49.363374 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fc92e48-a662-417d-8118-f9e3d841406b could not be found. Jun 01 04:46:49.363374 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:46:49.363374 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:46:49.363374 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:46:49.363374 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:46:49.363374 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:46:49.363374 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:46:49.363374 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:46:49.363374 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:46:49.363374 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:46:49.365148 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:46:49.365148 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 01 04:46:49.365148 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 01 04:46:49.365148 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:46:49.365148 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:46:49.365148 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:46:49.365148 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:46:49.365148 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fc92e48-a662-417d-8118-f9e3d841406b could not be found. Jun 01 04:46:49.365148 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:46:49.365148 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:46:49.365148 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:46:49.365148 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:46:49.365148 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:46:49.365148 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:46:49.365148 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:46:49.365148 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:46:49.365148 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fc92e48-a662-417d-8118-f9e3d841406b could not be found. Jun 01 04:46:49.365148 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:46:49.366925 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-7c328cec-3b67-47df-8f57-2a319867545c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Returning 404 to user: Instance 2fc92e48-a662-417d-8118-f9e3d841406b could not be found. {{(pid=118516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:46:49.366925 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-7c328cec-3b67-47df-8f57-2a319867545c tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b" status: 404 len: 111 microversion: 2.1 time: 0.030605 Jun 01 04:46:49.366925 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 626/1237] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:46:49 2022] GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:46:49.374987 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-804f415f-40e5-4092-9155-967b85b396cd tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '.version_select at 0x7ff32568b820>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:46:49.429814 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-804f415f-40e5-4092-9155-967b85b396cd tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-184084567" status: 202 len: 0 microversion: 2.1 time: 0.062042 Jun 01 04:46:49.430382 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 612/1238] 10.222.0.18 () {58 vars in 1217 bytes} [Wed Jun 1 04:46:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-184084567 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 01 04:46:51.489389 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-0dd713c1-a5d3-4507-b542-6f46c1cd3866 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:46:51.489917 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-0dd713c1-a5d3-4507-b542-6f46c1cd3866 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 2fc92e48-a662-417d-8118-f9e3d841406b] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:46:51.496472 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0dd713c1-a5d3-4507-b542-6f46c1cd3866 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:51.496924 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0dd713c1-a5d3-4507-b542-6f46c1cd3866 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:51.497702 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0dd713c1-a5d3-4507-b542-6f46c1cd3866 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:51.498148 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-0dd713c1-a5d3-4507-b542-6f46c1cd3866 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:51.511578 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.wsgi [None req-0dd713c1-a5d3-4507-b542-6f46c1cd3866 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] HTTP exception thrown: Instance 2fc92e48-a662-417d-8118-f9e3d841406b could not be found. Jun 01 04:46:51.513597 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-0dd713c1-a5d3-4507-b542-6f46c1cd3866 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Request method failure captured: Jun 01 04:46:51.513597 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: request: DELETE /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b HTTP/1.1 Jun 01 04:46:51.513597 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept: application/json Jun 01 04:46:51.513597 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept-Encoding: identity Jun 01 04:46:51.513597 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Connection: close Jun 01 04:46:51.513597 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Length: 0 Jun 01 04:46:51.513597 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Type: application/json Jun 01 04:46:51.513597 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Host: 10.222.0.18 Jun 01 04:46:51.513597 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Openstack-System-Scope: None Jun 01 04:46:51.513597 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: User-Agent: python-urllib3/1.26.9 Jun 01 04:46:51.513597 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Auth-Token: gAAAAABilu106jtQ5FQFoI4uiqXA9VQRHJyx7H5fGGtMI-QLhZ9wzEW4QntKBbHMyg13vDMrRhGraMRm2tDoM-Qty4nj0NCDDE4r_xFFVOkMZvSyYWVAglaTnBtH6geTi9BY7b2EpB-efWXbewEEXtidDt5wGfiLJoigjqd8nO6N2RC-Av-UzW8 Jun 01 04:46:51.513597 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Id: None Jun 01 04:46:51.513597 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Name: None Jun 01 04:46:51.513597 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Identity-Status: Confirmed Jun 01 04:46:51.513597 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Is-Admin-Project: True Jun 01 04:46:51.513597 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Id: default Jun 01 04:46:51.513597 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Name: Default Jun 01 04:46:51.513597 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Id: 756cb4ed8d2345dcaae27638b257a480 Jun 01 04:46:51.513597 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Name: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:46:51.513597 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Role: reader,member Jun 01 04:46:51.513597 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Roles: reader,member Jun 01 04:46:51.517510 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:46:51.517510 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:46:51.517510 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Id: 756cb4ed8d2345dcaae27638b257a480 Jun 01 04:46:51.517510 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:46:51.517510 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User: tempest-AttachVolumeNegativeTest-373300167-project Jun 01 04:46:51.517510 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Id: default Jun 01 04:46:51.517510 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Name: Default Jun 01 04:46:51.517510 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Id: a17f39a1626d45299666f43be4ffc3ec Jun 01 04:46:51.517510 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Name: tempest-AttachVolumeNegativeTest-373300167-project Jun 01 04:46:51.517510 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: method: > Jun 01 04:46:51.517510 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: exception: Instance 2fc92e48-a662-417d-8118-f9e3d841406b could not be found. Jun 01 04:46:51.517510 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: action_args: {'id': '2fc92e48-a662-417d-8118-f9e3d841406b'} Jun 01 04:46:51.518482 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:46:51.518482 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:46:51.518482 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:46:51.518482 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:46:51.518482 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:46:51.518482 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:46:51.518482 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:46:51.518482 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:46:51.518482 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:46:51.518482 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:46:51.518482 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fc92e48-a662-417d-8118-f9e3d841406b could not be found. Jun 01 04:46:51.518482 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:46:51.518482 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:46:51.518482 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:46:51.518482 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:46:51.518482 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:46:51.518482 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:46:51.518482 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:46:51.518482 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:46:51.518482 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:46:51.520226 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:46:51.520226 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 01 04:46:51.520226 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 01 04:46:51.520226 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 01 04:46:51.520226 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 01 04:46:51.520226 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:46:51.520226 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:46:51.520226 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:46:51.520226 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:46:51.520226 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fc92e48-a662-417d-8118-f9e3d841406b could not be found. Jun 01 04:46:51.520226 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:46:51.520226 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:46:51.520226 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:46:51.520226 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:46:51.520226 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:46:51.520226 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:46:51.520226 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:46:51.520226 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:46:51.520226 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fc92e48-a662-417d-8118-f9e3d841406b could not be found. Jun 01 04:46:51.520226 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:46:51.521906 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-0dd713c1-a5d3-4507-b542-6f46c1cd3866 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Returning 404 to user: Instance 2fc92e48-a662-417d-8118-f9e3d841406b could not be found. {{(pid=118516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:46:51.521906 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-0dd713c1-a5d3-4507-b542-6f46c1cd3866 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b" status: 404 len: 111 microversion: 2.1 time: 0.029407 Jun 01 04:46:51.521906 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 627/1239] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 1 04:46:51 2022] DELETE /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:46:51.524195 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-ac5d061b-0f60-4f44-8590-c7fc5789ae03 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:46:51.524811 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-ac5d061b-0f60-4f44-8590-c7fc5789ae03 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 2fc92e48-a662-417d-8118-f9e3d841406b] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:46:51.532958 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ac5d061b-0f60-4f44-8590-c7fc5789ae03 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:51.533597 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ac5d061b-0f60-4f44-8590-c7fc5789ae03 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:51.534466 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ac5d061b-0f60-4f44-8590-c7fc5789ae03 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:51.535069 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-ac5d061b-0f60-4f44-8590-c7fc5789ae03 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:51.549494 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.wsgi [None req-ac5d061b-0f60-4f44-8590-c7fc5789ae03 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] HTTP exception thrown: Instance 2fc92e48-a662-417d-8118-f9e3d841406b could not be found. Jun 01 04:46:51.551105 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-ac5d061b-0f60-4f44-8590-c7fc5789ae03 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Request method failure captured: Jun 01 04:46:51.551105 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: request: GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b HTTP/1.1 Jun 01 04:46:51.551105 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept: application/json Jun 01 04:46:51.551105 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept-Encoding: identity Jun 01 04:46:51.551105 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Connection: close Jun 01 04:46:51.551105 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Length: 0 Jun 01 04:46:51.551105 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Type: application/json Jun 01 04:46:51.551105 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Host: 10.222.0.18 Jun 01 04:46:51.551105 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Openstack-System-Scope: None Jun 01 04:46:51.551105 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: User-Agent: python-urllib3/1.26.9 Jun 01 04:46:51.551105 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Auth-Token: gAAAAABilu106jtQ5FQFoI4uiqXA9VQRHJyx7H5fGGtMI-QLhZ9wzEW4QntKBbHMyg13vDMrRhGraMRm2tDoM-Qty4nj0NCDDE4r_xFFVOkMZvSyYWVAglaTnBtH6geTi9BY7b2EpB-efWXbewEEXtidDt5wGfiLJoigjqd8nO6N2RC-Av-UzW8 Jun 01 04:46:51.551105 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Id: None Jun 01 04:46:51.551105 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Name: None Jun 01 04:46:51.551105 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Identity-Status: Confirmed Jun 01 04:46:51.551105 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Is-Admin-Project: True Jun 01 04:46:51.551105 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Id: default Jun 01 04:46:51.551105 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Name: Default Jun 01 04:46:51.551105 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Id: 756cb4ed8d2345dcaae27638b257a480 Jun 01 04:46:51.551105 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Name: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:46:51.551105 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Role: reader,member Jun 01 04:46:51.551105 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Roles: reader,member Jun 01 04:46:51.552823 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:46:51.552823 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:46:51.552823 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Id: 756cb4ed8d2345dcaae27638b257a480 Jun 01 04:46:51.552823 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:46:51.552823 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User: tempest-AttachVolumeNegativeTest-373300167-project Jun 01 04:46:51.552823 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Id: default Jun 01 04:46:51.552823 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Name: Default Jun 01 04:46:51.552823 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Id: a17f39a1626d45299666f43be4ffc3ec Jun 01 04:46:51.552823 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Name: tempest-AttachVolumeNegativeTest-373300167-project Jun 01 04:46:51.552823 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: method: > Jun 01 04:46:51.552823 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: exception: Instance 2fc92e48-a662-417d-8118-f9e3d841406b could not be found. Jun 01 04:46:51.552823 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: action_args: {'id': '2fc92e48-a662-417d-8118-f9e3d841406b'} Jun 01 04:46:51.553757 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:46:51.553757 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:46:51.553757 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:46:51.553757 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:46:51.553757 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:46:51.553757 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:46:51.553757 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:46:51.553757 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:46:51.553757 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:46:51.553757 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:46:51.553757 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fc92e48-a662-417d-8118-f9e3d841406b could not be found. Jun 01 04:46:51.553757 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:46:51.553757 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:46:51.553757 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:46:51.553757 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:46:51.553757 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:46:51.553757 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:46:51.553757 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:46:51.553757 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:46:51.553757 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:46:51.555431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:46:51.555431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 01 04:46:51.555431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 01 04:46:51.555431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:46:51.555431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:46:51.555431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:46:51.555431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:46:51.555431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fc92e48-a662-417d-8118-f9e3d841406b could not be found. Jun 01 04:46:51.555431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:46:51.555431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:46:51.555431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:46:51.555431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:46:51.555431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:46:51.555431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:46:51.555431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:46:51.555431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:46:51.555431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fc92e48-a662-417d-8118-f9e3d841406b could not be found. Jun 01 04:46:51.555431 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:46:51.556770 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-ac5d061b-0f60-4f44-8590-c7fc5789ae03 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Returning 404 to user: Instance 2fc92e48-a662-417d-8118-f9e3d841406b could not be found. {{(pid=118517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:46:51.556770 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-ac5d061b-0f60-4f44-8590-c7fc5789ae03 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b" status: 404 len: 111 microversion: 2.1 time: 0.032397 Jun 01 04:46:51.556770 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 613/1240] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:46:51 2022] GET /compute/v2.1/servers/2fc92e48-a662-417d-8118-f9e3d841406b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:46:52.883794 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-4a7cecea-caa1-4622-ba66-7f7909b00af7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:46:52.884381 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-4a7cecea-caa1-4622-ba66-7f7909b00af7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: ab5cfe14-4eed-4104-b042-20724e4ba94f] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:46:52.891203 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4a7cecea-caa1-4622-ba66-7f7909b00af7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:52.891677 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4a7cecea-caa1-4622-ba66-7f7909b00af7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:52.892433 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4a7cecea-caa1-4622-ba66-7f7909b00af7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:52.892866 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-4a7cecea-caa1-4622-ba66-7f7909b00af7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:52.908899 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.wsgi [None req-4a7cecea-caa1-4622-ba66-7f7909b00af7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] HTTP exception thrown: Instance ab5cfe14-4eed-4104-b042-20724e4ba94f could not be found. Jun 01 04:46:52.910407 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-4a7cecea-caa1-4622-ba66-7f7909b00af7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Request method failure captured: Jun 01 04:46:52.910407 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: request: DELETE /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f HTTP/1.1 Jun 01 04:46:52.910407 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept: application/json Jun 01 04:46:52.910407 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept-Encoding: identity Jun 01 04:46:52.910407 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Connection: close Jun 01 04:46:52.910407 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Length: 0 Jun 01 04:46:52.910407 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Type: application/json Jun 01 04:46:52.910407 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Host: 10.222.0.18 Jun 01 04:46:52.910407 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Openstack-System-Scope: None Jun 01 04:46:52.910407 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: User-Agent: python-urllib3/1.26.9 Jun 01 04:46:52.910407 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Auth-Token: gAAAAABilu106jtQ5FQFoI4uiqXA9VQRHJyx7H5fGGtMI-QLhZ9wzEW4QntKBbHMyg13vDMrRhGraMRm2tDoM-Qty4nj0NCDDE4r_xFFVOkMZvSyYWVAglaTnBtH6geTi9BY7b2EpB-efWXbewEEXtidDt5wGfiLJoigjqd8nO6N2RC-Av-UzW8 Jun 01 04:46:52.910407 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Id: None Jun 01 04:46:52.910407 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Name: None Jun 01 04:46:52.910407 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Identity-Status: Confirmed Jun 01 04:46:52.910407 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Is-Admin-Project: True Jun 01 04:46:52.910407 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Id: default Jun 01 04:46:52.910407 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Name: Default Jun 01 04:46:52.910407 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Id: 756cb4ed8d2345dcaae27638b257a480 Jun 01 04:46:52.910407 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Name: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:46:52.910407 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Role: reader,member Jun 01 04:46:52.910407 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Roles: reader,member Jun 01 04:46:52.912403 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:46:52.912403 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:46:52.912403 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Id: 756cb4ed8d2345dcaae27638b257a480 Jun 01 04:46:52.912403 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:46:52.912403 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User: tempest-AttachVolumeNegativeTest-373300167-project Jun 01 04:46:52.912403 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Id: default Jun 01 04:46:52.912403 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Name: Default Jun 01 04:46:52.912403 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Id: a17f39a1626d45299666f43be4ffc3ec Jun 01 04:46:52.912403 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Name: tempest-AttachVolumeNegativeTest-373300167-project Jun 01 04:46:52.912403 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: method: > Jun 01 04:46:52.912403 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: exception: Instance ab5cfe14-4eed-4104-b042-20724e4ba94f could not be found. Jun 01 04:46:52.912403 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: action_args: {'id': 'ab5cfe14-4eed-4104-b042-20724e4ba94f'} Jun 01 04:46:52.914012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:46:52.914012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:46:52.914012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:46:52.914012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:46:52.914012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:46:52.914012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:46:52.914012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:46:52.914012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:46:52.914012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:46:52.914012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:46:52.914012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab5cfe14-4eed-4104-b042-20724e4ba94f could not be found. Jun 01 04:46:52.914012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:46:52.914012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:46:52.914012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:46:52.914012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:46:52.914012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:46:52.914012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:46:52.914012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:46:52.914012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:46:52.914012 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:46:52.916833 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:46:52.916833 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 01 04:46:52.916833 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 01 04:46:52.916833 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 01 04:46:52.916833 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 01 04:46:52.916833 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:46:52.916833 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:46:52.916833 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:46:52.916833 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:46:52.916833 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab5cfe14-4eed-4104-b042-20724e4ba94f could not be found. Jun 01 04:46:52.916833 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:46:52.916833 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:46:52.916833 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:46:52.916833 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:46:52.916833 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:46:52.916833 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:46:52.916833 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:46:52.916833 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:46:52.916833 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab5cfe14-4eed-4104-b042-20724e4ba94f could not be found. Jun 01 04:46:52.916833 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:46:52.919575 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-4a7cecea-caa1-4622-ba66-7f7909b00af7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Returning 404 to user: Instance ab5cfe14-4eed-4104-b042-20724e4ba94f could not be found. {{(pid=118516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:46:52.919575 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-4a7cecea-caa1-4622-ba66-7f7909b00af7 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f" status: 404 len: 111 microversion: 2.1 time: 0.031862 Jun 01 04:46:52.919575 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 628/1241] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 1 04:46:52 2022] DELETE /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:46:52.920170 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-5695f3cd-af64-470d-955d-d5628c9d5991 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:46:52.920871 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-5695f3cd-af64-470d-955d-d5628c9d5991 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: ab5cfe14-4eed-4104-b042-20724e4ba94f] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:46:52.927275 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5695f3cd-af64-470d-955d-d5628c9d5991 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:52.927752 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5695f3cd-af64-470d-955d-d5628c9d5991 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:52.928504 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5695f3cd-af64-470d-955d-d5628c9d5991 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:52.928934 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-5695f3cd-af64-470d-955d-d5628c9d5991 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:52.943034 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.wsgi [None req-5695f3cd-af64-470d-955d-d5628c9d5991 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] HTTP exception thrown: Instance ab5cfe14-4eed-4104-b042-20724e4ba94f could not be found. Jun 01 04:46:52.944623 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-5695f3cd-af64-470d-955d-d5628c9d5991 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Request method failure captured: Jun 01 04:46:52.944623 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: request: GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f HTTP/1.1 Jun 01 04:46:52.944623 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept: application/json Jun 01 04:46:52.944623 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept-Encoding: identity Jun 01 04:46:52.944623 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Connection: close Jun 01 04:46:52.944623 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Length: 0 Jun 01 04:46:52.944623 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Type: application/json Jun 01 04:46:52.944623 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Host: 10.222.0.18 Jun 01 04:46:52.944623 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Openstack-System-Scope: None Jun 01 04:46:52.944623 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: User-Agent: python-urllib3/1.26.9 Jun 01 04:46:52.944623 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Auth-Token: gAAAAABilu106jtQ5FQFoI4uiqXA9VQRHJyx7H5fGGtMI-QLhZ9wzEW4QntKBbHMyg13vDMrRhGraMRm2tDoM-Qty4nj0NCDDE4r_xFFVOkMZvSyYWVAglaTnBtH6geTi9BY7b2EpB-efWXbewEEXtidDt5wGfiLJoigjqd8nO6N2RC-Av-UzW8 Jun 01 04:46:52.944623 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Id: None Jun 01 04:46:52.944623 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Name: None Jun 01 04:46:52.944623 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Identity-Status: Confirmed Jun 01 04:46:52.944623 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Is-Admin-Project: True Jun 01 04:46:52.944623 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Id: default Jun 01 04:46:52.944623 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Name: Default Jun 01 04:46:52.944623 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Id: 756cb4ed8d2345dcaae27638b257a480 Jun 01 04:46:52.944623 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Name: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:46:52.944623 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Role: reader,member Jun 01 04:46:52.944623 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Roles: reader,member Jun 01 04:46:52.946444 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:46:52.946444 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:46:52.946444 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Id: 756cb4ed8d2345dcaae27638b257a480 Jun 01 04:46:52.946444 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:46:52.946444 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User: tempest-AttachVolumeNegativeTest-373300167-project Jun 01 04:46:52.946444 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Id: default Jun 01 04:46:52.946444 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Name: Default Jun 01 04:46:52.946444 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Id: a17f39a1626d45299666f43be4ffc3ec Jun 01 04:46:52.946444 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Name: tempest-AttachVolumeNegativeTest-373300167-project Jun 01 04:46:52.946444 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: method: > Jun 01 04:46:52.946444 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: exception: Instance ab5cfe14-4eed-4104-b042-20724e4ba94f could not be found. Jun 01 04:46:52.946444 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: action_args: {'id': 'ab5cfe14-4eed-4104-b042-20724e4ba94f'} Jun 01 04:46:52.947517 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:46:52.947517 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:46:52.947517 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:46:52.947517 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:46:52.947517 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:46:52.947517 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:46:52.947517 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:46:52.947517 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:46:52.947517 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:46:52.947517 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:46:52.947517 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab5cfe14-4eed-4104-b042-20724e4ba94f could not be found. Jun 01 04:46:52.947517 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:46:52.947517 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:46:52.947517 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:46:52.947517 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:46:52.947517 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:46:52.947517 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:46:52.947517 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:46:52.947517 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:46:52.947517 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:46:52.949138 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:46:52.949138 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 01 04:46:52.949138 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 01 04:46:52.949138 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:46:52.949138 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:46:52.949138 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:46:52.949138 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:46:52.949138 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab5cfe14-4eed-4104-b042-20724e4ba94f could not be found. Jun 01 04:46:52.949138 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:46:52.949138 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:46:52.949138 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:46:52.949138 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:46:52.949138 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:46:52.949138 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:46:52.949138 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:46:52.949138 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:46:52.949138 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab5cfe14-4eed-4104-b042-20724e4ba94f could not be found. Jun 01 04:46:52.949138 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:46:52.955089 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-5695f3cd-af64-470d-955d-d5628c9d5991 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Returning 404 to user: Instance ab5cfe14-4eed-4104-b042-20724e4ba94f could not be found. {{(pid=118517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:46:52.955089 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-5695f3cd-af64-470d-955d-d5628c9d5991 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f" status: 404 len: 111 microversion: 2.1 time: 0.029573 Jun 01 04:46:52.955089 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 614/1242] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:46:52 2022] GET /compute/v2.1/servers/ab5cfe14-4eed-4104-b042-20724e4ba94f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 01 04:46:52.955385 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-e61000ba-3499-44b2-bde2-09881dcdb43e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:46:52.955385 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-e61000ba-3499-44b2-bde2-09881dcdb43e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 20a718f6-2774-49f5-833a-4aca569ae1b7] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:46:52.961674 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e61000ba-3499-44b2-bde2-09881dcdb43e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:52.962126 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e61000ba-3499-44b2-bde2-09881dcdb43e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:52.962897 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e61000ba-3499-44b2-bde2-09881dcdb43e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:52.963433 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-e61000ba-3499-44b2-bde2-09881dcdb43e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:52.977550 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.wsgi [None req-e61000ba-3499-44b2-bde2-09881dcdb43e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] HTTP exception thrown: Instance 20a718f6-2774-49f5-833a-4aca569ae1b7 could not be found. Jun 01 04:46:52.979077 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-e61000ba-3499-44b2-bde2-09881dcdb43e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Request method failure captured: Jun 01 04:46:52.979077 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: request: DELETE /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7 HTTP/1.1 Jun 01 04:46:52.979077 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept: application/json Jun 01 04:46:52.979077 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept-Encoding: identity Jun 01 04:46:52.979077 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Connection: close Jun 01 04:46:52.979077 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Length: 0 Jun 01 04:46:52.979077 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Type: application/json Jun 01 04:46:52.979077 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Host: 10.222.0.18 Jun 01 04:46:52.979077 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Openstack-System-Scope: None Jun 01 04:46:52.979077 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: User-Agent: python-urllib3/1.26.9 Jun 01 04:46:52.979077 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Auth-Token: gAAAAABilu106jtQ5FQFoI4uiqXA9VQRHJyx7H5fGGtMI-QLhZ9wzEW4QntKBbHMyg13vDMrRhGraMRm2tDoM-Qty4nj0NCDDE4r_xFFVOkMZvSyYWVAglaTnBtH6geTi9BY7b2EpB-efWXbewEEXtidDt5wGfiLJoigjqd8nO6N2RC-Av-UzW8 Jun 01 04:46:52.979077 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Id: None Jun 01 04:46:52.979077 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Name: None Jun 01 04:46:52.979077 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Identity-Status: Confirmed Jun 01 04:46:52.979077 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Is-Admin-Project: True Jun 01 04:46:52.979077 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Id: default Jun 01 04:46:52.979077 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Name: Default Jun 01 04:46:52.979077 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Id: 756cb4ed8d2345dcaae27638b257a480 Jun 01 04:46:52.979077 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Name: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:46:52.979077 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Role: reader,member Jun 01 04:46:52.979077 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Roles: reader,member Jun 01 04:46:52.980946 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:46:52.980946 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:46:52.980946 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Id: 756cb4ed8d2345dcaae27638b257a480 Jun 01 04:46:52.980946 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:46:52.980946 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User: tempest-AttachVolumeNegativeTest-373300167-project Jun 01 04:46:52.980946 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Id: default Jun 01 04:46:52.980946 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Name: Default Jun 01 04:46:52.980946 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Id: a17f39a1626d45299666f43be4ffc3ec Jun 01 04:46:52.980946 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Name: tempest-AttachVolumeNegativeTest-373300167-project Jun 01 04:46:52.980946 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: method: > Jun 01 04:46:52.980946 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: exception: Instance 20a718f6-2774-49f5-833a-4aca569ae1b7 could not be found. Jun 01 04:46:52.980946 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: action_args: {'id': '20a718f6-2774-49f5-833a-4aca569ae1b7'} Jun 01 04:46:52.982274 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:46:52.982274 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:46:52.982274 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:46:52.982274 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:46:52.982274 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:46:52.982274 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:46:52.982274 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:46:52.982274 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:46:52.982274 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:46:52.982274 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:46:52.982274 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20a718f6-2774-49f5-833a-4aca569ae1b7 could not be found. Jun 01 04:46:52.982274 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:46:52.982274 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:46:52.982274 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:46:52.982274 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:46:52.982274 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:46:52.982274 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:46:52.982274 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:46:52.982274 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:46:52.982274 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:46:52.983979 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:46:52.983979 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 01 04:46:52.983979 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 01 04:46:52.983979 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 01 04:46:52.983979 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 01 04:46:52.983979 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:46:52.983979 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:46:52.983979 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:46:52.983979 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:46:52.983979 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20a718f6-2774-49f5-833a-4aca569ae1b7 could not be found. Jun 01 04:46:52.983979 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:46:52.983979 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:46:52.983979 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:46:52.983979 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:46:52.983979 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:46:52.983979 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:46:52.983979 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:46:52.983979 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:46:52.983979 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20a718f6-2774-49f5-833a-4aca569ae1b7 could not be found. Jun 01 04:46:52.983979 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:46:52.985624 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-e61000ba-3499-44b2-bde2-09881dcdb43e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Returning 404 to user: Instance 20a718f6-2774-49f5-833a-4aca569ae1b7 could not be found. {{(pid=118516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:46:52.985624 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-e61000ba-3499-44b2-bde2-09881dcdb43e tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "DELETE /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7" status: 404 len: 111 microversion: 2.1 time: 0.029976 Jun 01 04:46:52.985624 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 629/1243] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 1 04:46:52 2022] DELETE /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:46:52.988913 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-2ab5b15a-925e-4dbd-8949-ce5e99306a5d tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:46:52.989548 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-2ab5b15a-925e-4dbd-8949-ce5e99306a5d tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 20a718f6-2774-49f5-833a-4aca569ae1b7] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:46:52.995573 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2ab5b15a-925e-4dbd-8949-ce5e99306a5d tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:52.996026 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2ab5b15a-925e-4dbd-8949-ce5e99306a5d tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:52.997767 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2ab5b15a-925e-4dbd-8949-ce5e99306a5d tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:52.998205 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-2ab5b15a-925e-4dbd-8949-ce5e99306a5d tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:53.011698 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.wsgi [None req-2ab5b15a-925e-4dbd-8949-ce5e99306a5d tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] HTTP exception thrown: Instance 20a718f6-2774-49f5-833a-4aca569ae1b7 could not be found. Jun 01 04:46:53.013713 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-2ab5b15a-925e-4dbd-8949-ce5e99306a5d tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Request method failure captured: Jun 01 04:46:53.013713 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: request: GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7 HTTP/1.1 Jun 01 04:46:53.013713 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept: application/json Jun 01 04:46:53.013713 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept-Encoding: identity Jun 01 04:46:53.013713 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Connection: close Jun 01 04:46:53.013713 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Length: 0 Jun 01 04:46:53.013713 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Type: application/json Jun 01 04:46:53.013713 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Host: 10.222.0.18 Jun 01 04:46:53.013713 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Openstack-System-Scope: None Jun 01 04:46:53.013713 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: User-Agent: python-urllib3/1.26.9 Jun 01 04:46:53.013713 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Auth-Token: gAAAAABilu106jtQ5FQFoI4uiqXA9VQRHJyx7H5fGGtMI-QLhZ9wzEW4QntKBbHMyg13vDMrRhGraMRm2tDoM-Qty4nj0NCDDE4r_xFFVOkMZvSyYWVAglaTnBtH6geTi9BY7b2EpB-efWXbewEEXtidDt5wGfiLJoigjqd8nO6N2RC-Av-UzW8 Jun 01 04:46:53.013713 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Id: None Jun 01 04:46:53.013713 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Name: None Jun 01 04:46:53.013713 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Identity-Status: Confirmed Jun 01 04:46:53.013713 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Is-Admin-Project: True Jun 01 04:46:53.013713 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Id: default Jun 01 04:46:53.013713 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Name: Default Jun 01 04:46:53.013713 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Id: 756cb4ed8d2345dcaae27638b257a480 Jun 01 04:46:53.013713 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Name: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:46:53.013713 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Role: reader,member Jun 01 04:46:53.013713 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Roles: reader,member Jun 01 04:46:53.015462 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:46:53.015462 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:46:53.015462 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Id: 756cb4ed8d2345dcaae27638b257a480 Jun 01 04:46:53.015462 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:46:53.015462 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User: tempest-AttachVolumeNegativeTest-373300167-project Jun 01 04:46:53.015462 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Id: default Jun 01 04:46:53.015462 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Name: Default Jun 01 04:46:53.015462 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Id: a17f39a1626d45299666f43be4ffc3ec Jun 01 04:46:53.015462 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Name: tempest-AttachVolumeNegativeTest-373300167-project Jun 01 04:46:53.015462 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: method: > Jun 01 04:46:53.015462 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: exception: Instance 20a718f6-2774-49f5-833a-4aca569ae1b7 could not be found. Jun 01 04:46:53.015462 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: action_args: {'id': '20a718f6-2774-49f5-833a-4aca569ae1b7'} Jun 01 04:46:53.016530 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:46:53.016530 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:46:53.016530 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:46:53.016530 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:46:53.016530 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:46:53.016530 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:46:53.016530 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:46:53.016530 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:46:53.016530 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:46:53.016530 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:46:53.016530 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20a718f6-2774-49f5-833a-4aca569ae1b7 could not be found. Jun 01 04:46:53.016530 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:46:53.016530 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:46:53.016530 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:46:53.016530 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:46:53.016530 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:46:53.016530 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:46:53.016530 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:46:53.016530 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:46:53.016530 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:46:53.018100 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:46:53.018100 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 01 04:46:53.018100 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 01 04:46:53.018100 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:46:53.018100 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:46:53.018100 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:46:53.018100 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:46:53.018100 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20a718f6-2774-49f5-833a-4aca569ae1b7 could not be found. Jun 01 04:46:53.018100 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:46:53.018100 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:46:53.018100 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:46:53.018100 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:46:53.018100 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:46:53.018100 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:46:53.018100 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:46:53.018100 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:46:53.018100 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20a718f6-2774-49f5-833a-4aca569ae1b7 could not be found. Jun 01 04:46:53.018100 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:46:53.019551 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-2ab5b15a-925e-4dbd-8949-ce5e99306a5d tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Returning 404 to user: Instance 20a718f6-2774-49f5-833a-4aca569ae1b7 could not be found. {{(pid=118517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:46:53.019551 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-2ab5b15a-925e-4dbd-8949-ce5e99306a5d tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7" status: 404 len: 111 microversion: 2.1 time: 0.029924 Jun 01 04:46:53.019551 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 615/1244] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:46:52 2022] GET /compute/v2.1/servers/20a718f6-2774-49f5-833a-4aca569ae1b7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:46:54.296825 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-49df494b-82f2-4d46-8b09-cd5d5daeb176 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:46:54.297367 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.compute.api [None req-49df494b-82f2-4d46-8b09-cd5d5daeb176 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 51a21959-da2d-4c3c-8b95-02847c3cf58a] Fetching instance by UUID {{(pid=118516) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:46:54.303969 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-49df494b-82f2-4d46-8b09-cd5d5daeb176 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:54.304429 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-49df494b-82f2-4d46-8b09-cd5d5daeb176 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:54.305208 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-49df494b-82f2-4d46-8b09-cd5d5daeb176 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:54.305648 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG oslo_concurrency.lockutils [None req-49df494b-82f2-4d46-8b09-cd5d5daeb176 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:54.319088 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.wsgi [None req-49df494b-82f2-4d46-8b09-cd5d5daeb176 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] HTTP exception thrown: Instance 51a21959-da2d-4c3c-8b95-02847c3cf58a could not be found. Jun 01 04:46:54.320728 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-49df494b-82f2-4d46-8b09-cd5d5daeb176 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Request method failure captured: Jun 01 04:46:54.320728 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: request: DELETE /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a HTTP/1.1 Jun 01 04:46:54.320728 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept: application/json Jun 01 04:46:54.320728 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Accept-Encoding: identity Jun 01 04:46:54.320728 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Connection: close Jun 01 04:46:54.320728 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Length: 0 Jun 01 04:46:54.320728 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Content-Type: application/json Jun 01 04:46:54.320728 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Host: 10.222.0.18 Jun 01 04:46:54.320728 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Openstack-System-Scope: None Jun 01 04:46:54.320728 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: User-Agent: python-urllib3/1.26.9 Jun 01 04:46:54.320728 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Auth-Token: gAAAAABilu106jtQ5FQFoI4uiqXA9VQRHJyx7H5fGGtMI-QLhZ9wzEW4QntKBbHMyg13vDMrRhGraMRm2tDoM-Qty4nj0NCDDE4r_xFFVOkMZvSyYWVAglaTnBtH6geTi9BY7b2EpB-efWXbewEEXtidDt5wGfiLJoigjqd8nO6N2RC-Av-UzW8 Jun 01 04:46:54.320728 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Id: None Jun 01 04:46:54.320728 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Domain-Name: None Jun 01 04:46:54.320728 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Identity-Status: Confirmed Jun 01 04:46:54.320728 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Is-Admin-Project: True Jun 01 04:46:54.320728 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Id: default Jun 01 04:46:54.320728 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Domain-Name: Default Jun 01 04:46:54.320728 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Id: 756cb4ed8d2345dcaae27638b257a480 Jun 01 04:46:54.320728 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Project-Name: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:46:54.320728 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Role: reader,member Jun 01 04:46:54.320728 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Roles: reader,member Jun 01 04:46:54.322547 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:46:54.322547 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:46:54.322547 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Id: 756cb4ed8d2345dcaae27638b257a480 Jun 01 04:46:54.322547 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:46:54.322547 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User: tempest-AttachVolumeNegativeTest-373300167-project Jun 01 04:46:54.322547 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Id: default Jun 01 04:46:54.322547 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Domain-Name: Default Jun 01 04:46:54.322547 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Id: a17f39a1626d45299666f43be4ffc3ec Jun 01 04:46:54.322547 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: X-User-Name: tempest-AttachVolumeNegativeTest-373300167-project Jun 01 04:46:54.322547 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: method: > Jun 01 04:46:54.322547 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: exception: Instance 51a21959-da2d-4c3c-8b95-02847c3cf58a could not be found. Jun 01 04:46:54.322547 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: action_args: {'id': '51a21959-da2d-4c3c-8b95-02847c3cf58a'} Jun 01 04:46:54.323435 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: {{(pid=118516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:46:54.323435 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:46:54.323435 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:46:54.323435 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:46:54.323435 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:46:54.323435 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:46:54.323435 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:46:54.323435 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:46:54.323435 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:46:54.323435 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:46:54.323435 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51a21959-da2d-4c3c-8b95-02847c3cf58a could not be found. Jun 01 04:46:54.323435 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:46:54.323435 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:46:54.323435 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:46:54.323435 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:46:54.323435 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:46:54.323435 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:46:54.323435 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:46:54.323435 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:46:54.323435 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:46:54.324754 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:46:54.324754 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 01 04:46:54.324754 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 01 04:46:54.324754 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 01 04:46:54.324754 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 01 04:46:54.324754 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:46:54.324754 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:46:54.324754 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:46:54.324754 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:46:54.324754 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51a21959-da2d-4c3c-8b95-02847c3cf58a could not be found. Jun 01 04:46:54.324754 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:46:54.324754 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:46:54.324754 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:46:54.324754 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:46:54.324754 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:46:54.324754 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:46:54.324754 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:46:54.324754 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:46:54.324754 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51a21959-da2d-4c3c-8b95-02847c3cf58a could not be found. Jun 01 04:46:54.324754 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: ERROR nova.api.openstack.wsgi Jun 01 04:46:54.326952 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: DEBUG nova.api.openstack.wsgi [None req-49df494b-82f2-4d46-8b09-cd5d5daeb176 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Returning 404 to user: Instance 51a21959-da2d-4c3c-8b95-02847c3cf58a could not be found. {{(pid=118516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:46:54.326952 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO nova.api.openstack.requestlog [None req-49df494b-82f2-4d46-8b09-cd5d5daeb176 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "DELETE /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a" status: 404 len: 111 microversion: 2.1 time: 0.029862 Jun 01 04:46:54.326952 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: [pid: 118516|app: 0|req: 630/1245] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jun 1 04:46:54 2022] DELETE /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:46:54.331723 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a02751ba-f09f-4d28-a654-992b23715e94 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Calling method '>' {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 01 04:46:54.332338 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.compute.api [None req-a02751ba-f09f-4d28-a654-992b23715e94 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] [instance: 51a21959-da2d-4c3c-8b95-02847c3cf58a] Fetching instance by UUID {{(pid=118517) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 01 04:46:54.338951 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a02751ba-f09f-4d28-a654-992b23715e94 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:54.339439 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a02751ba-f09f-4d28-a654-992b23715e94 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:54.340209 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a02751ba-f09f-4d28-a654-992b23715e94 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 01 04:46:54.340649 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG oslo_concurrency.lockutils [None req-a02751ba-f09f-4d28-a654-992b23715e94 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Lock "f8c01473-0ed5-4371-bff6-91e2cece601b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 01 04:46:54.355290 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.wsgi [None req-a02751ba-f09f-4d28-a654-992b23715e94 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] HTTP exception thrown: Instance 51a21959-da2d-4c3c-8b95-02847c3cf58a could not be found. Jun 01 04:46:54.356870 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a02751ba-f09f-4d28-a654-992b23715e94 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Request method failure captured: Jun 01 04:46:54.356870 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: request: GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a HTTP/1.1 Jun 01 04:46:54.356870 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept: application/json Jun 01 04:46:54.356870 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Accept-Encoding: identity Jun 01 04:46:54.356870 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Connection: close Jun 01 04:46:54.356870 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Length: 0 Jun 01 04:46:54.356870 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Content-Type: application/json Jun 01 04:46:54.356870 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Host: 10.222.0.18 Jun 01 04:46:54.356870 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Openstack-System-Scope: None Jun 01 04:46:54.356870 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: User-Agent: python-urllib3/1.26.9 Jun 01 04:46:54.356870 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Auth-Token: gAAAAABilu106jtQ5FQFoI4uiqXA9VQRHJyx7H5fGGtMI-QLhZ9wzEW4QntKBbHMyg13vDMrRhGraMRm2tDoM-Qty4nj0NCDDE4r_xFFVOkMZvSyYWVAglaTnBtH6geTi9BY7b2EpB-efWXbewEEXtidDt5wGfiLJoigjqd8nO6N2RC-Av-UzW8 Jun 01 04:46:54.356870 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Id: None Jun 01 04:46:54.356870 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Domain-Name: None Jun 01 04:46:54.356870 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Identity-Status: Confirmed Jun 01 04:46:54.356870 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Is-Admin-Project: True Jun 01 04:46:54.356870 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Id: default Jun 01 04:46:54.356870 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Domain-Name: Default Jun 01 04:46:54.356870 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Id: 756cb4ed8d2345dcaae27638b257a480 Jun 01 04:46:54.356870 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Project-Name: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:46:54.356870 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Role: reader,member Jun 01 04:46:54.356870 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Roles: reader,member Jun 01 04:46:54.358752 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/756cb4ed8d2345dcaae27638b257a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}] Jun 01 04:46:54.358752 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:46:54.358752 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Id: 756cb4ed8d2345dcaae27638b257a480 Jun 01 04:46:54.358752 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-373300167 Jun 01 04:46:54.358752 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User: tempest-AttachVolumeNegativeTest-373300167-project Jun 01 04:46:54.358752 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Id: default Jun 01 04:46:54.358752 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Domain-Name: Default Jun 01 04:46:54.358752 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Id: a17f39a1626d45299666f43be4ffc3ec Jun 01 04:46:54.358752 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: X-User-Name: tempest-AttachVolumeNegativeTest-373300167-project Jun 01 04:46:54.358752 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: method: > Jun 01 04:46:54.358752 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: exception: Instance 51a21959-da2d-4c3c-8b95-02847c3cf58a could not be found. Jun 01 04:46:54.358752 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: action_args: {'id': '51a21959-da2d-4c3c-8b95-02847c3cf58a'} Jun 01 04:46:54.359733 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: {{(pid=118517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 01 04:46:54.359733 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:46:54.359733 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 01 04:46:54.359733 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 01 04:46:54.359733 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 01 04:46:54.359733 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 01 04:46:54.359733 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 01 04:46:54.359733 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 01 04:46:54.359733 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 01 04:46:54.359733 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 01 04:46:54.359733 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51a21959-da2d-4c3c-8b95-02847c3cf58a could not be found. Jun 01 04:46:54.359733 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:46:54.359733 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:46:54.359733 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:46:54.359733 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:46:54.359733 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:46:54.359733 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:46:54.359733 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 01 04:46:54.359733 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 01 04:46:54.359733 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 01 04:46:54.361280 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 01 04:46:54.361280 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 01 04:46:54.361280 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 01 04:46:54.361280 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 01 04:46:54.361280 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 01 04:46:54.361280 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 01 04:46:54.361280 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 01 04:46:54.361280 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51a21959-da2d-4c3c-8b95-02847c3cf58a could not be found. Jun 01 04:46:54.361280 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:46:54.361280 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 01 04:46:54.361280 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:46:54.361280 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 01 04:46:54.361280 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 01 04:46:54.361280 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 01 04:46:54.361280 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 01 04:46:54.361280 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 01 04:46:54.361280 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51a21959-da2d-4c3c-8b95-02847c3cf58a could not be found. Jun 01 04:46:54.361280 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: ERROR nova.api.openstack.wsgi Jun 01 04:46:54.362832 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: DEBUG nova.api.openstack.wsgi [None req-a02751ba-f09f-4d28-a654-992b23715e94 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] Returning 404 to user: Instance 51a21959-da2d-4c3c-8b95-02847c3cf58a could not be found. {{(pid=118517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 01 04:46:54.362832 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO nova.api.openstack.requestlog [None req-a02751ba-f09f-4d28-a654-992b23715e94 tempest-AttachVolumeNegativeTest-373300167 tempest-AttachVolumeNegativeTest-373300167-project] 10.222.0.18 "GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a" status: 404 len: 111 microversion: 2.1 time: 0.030630 Jun 01 04:46:54.362832 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: [pid: 118517|app: 0|req: 616/1246] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jun 1 04:46:54 2022] GET /compute/v2.1/servers/51a21959-da2d-4c3c-8b95-02847c3cf58a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 01 04:47:38.607123 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 01 04:47:38.607782 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Wed Jun 1 04:47:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 01 04:47:41.171155 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 01 04:47:41.171754 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Wed Jun 1 04:47:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 01 04:49:13.102967 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 01 04:49:13.103687 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Wed Jun 1 04:49:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 01 04:49:53.544766 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 01 04:49:53.545366 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Wed Jun 1 04:49:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 01 04:50:58.615329 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 01 04:50:58.615944 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Wed Jun 1 04:50:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 01 04:51:01.179572 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 01 04:51:01.180174 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Wed Jun 1 04:51:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 01 04:52:21.088432 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 01 04:52:21.089160 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Wed Jun 1 04:52:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 01 04:52:33.111640 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 01 04:52:33.112254 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Wed Jun 1 04:52:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 01 04:52:47.095588 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 01 04:52:47.096299 dv-cinder-667108-37-iscsi devstack@n-api.service[118516]: Wed Jun 1 04:52:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 01 04:53:13.552647 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 01 04:53:13.553513 dv-cinder-667108-37-iscsi devstack@n-api.service[118517]: Wed Jun 1 04:53:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!